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ABSTRACT 

The Lethbridge School District Number 51 Project 
attempted to develop a more effective model for system, school, and 
program evaluation in the Lethbridge, Alberta (Canada) schools. A 
literature review suggested that a collaborative model would be 
effective and would result in empowerment of school-based personnel 
through active involvement. The use of educational quality indicators 
served as a key component in development of the Taodel. Current 
literature and input from committees and stakeholder groups were used 
to develop criteria in terms of indicators of effectiveness, quality, 
and improvement. Findings from the initial study were applied to the 
development of an evaluation of the arts and library programs with 
responses from 3,329 teachers, parents, and students for the art 
program; and 2,858 teachers, parents, and students for library 
programs. The final project stage focused on the art program and 
resulted in the identification of input, process, and outcome 
indicators of program effectiveness. Assessment processes to measure 
and verify outcomes were identified or developed, and a generic model 
was developed that could be applied to most program areas. The 
developed model is considered more effective than the former 
evaluation model used. Two tables and three figures illustrate the 
discussion. Five appendixes discuss the project teams and contain 
questionnaires and instruments used in the surveys. (SLD) 
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Abstract 



In recent years there has been a marked increase in the emphasis and expectations for 
school and program evaluations. Administrators and boaids need assurance that their 
models of school and program evaluation are consistent with increased effectiveness 
and school improvement as a result of tiie investments of professional time, expertise, 
and budget dollars. 

The purpose of tiie Lethbridge School District No. 51 Project was to develop a more 
effective naodel for system, school, and program evaluation. 

A review of the literature indicated that a collaborative nK)del for school and program 
evaluation would be more effective. In previous models, teachers and school-based 
administrators were not actively involved in the process and hence gained little from 
the exercise. The collaborative model resulted in the empowerment of school-based 
personnel through active involvement 

The use of educational quality indicators served as a key component in the 
development of the model. Current literature and input from established program 
sub-committees and stakeholder groups were used to develop characteristics or 
criteria, in terms of indicatorsof effectiveness, quality, and improveaienL 

The result has been the development of a model for schools to evaluate their own 
educational quality and effectiveness in a professional manner. This serves to 
empower staff to contribute to meaningful and effective school growth and 
improvement 

The findings from the initial study were applied to development of an evaluation of 
the art and library programs. The final stage of the project focused on the art program 
and resulted in die identification of input, process, and outcome indicators of program 
effectiveness. Assessment processes to measure and verify outcomes were identified 
or developed The generic model that was developed could be applied, with few 
modifications, to most program areas. 

As a result of the research project, it has been determined that the former model of 
program and school evaluation utilized in Lethbridge School District No. 51 was 
not consistent with the literature on indicators of effectiveness, quality, and school 
improvement. A collaborative model for school/program evaluations, in which the 
use of "educational quality indicators" is a key component, is more effective. 
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Chapter 1 



Introduction 

In recent years there has been a marked increase in the emphasis and expectations 
for school and program evaluations. Throughout much of Alberta, the approach 
used has been predominantly a '*top down" pnx:ess with the planning and 
procedures carried out almost exclusively by personnel from /\lberta Education or 
district central offices with assistance by external resource persons. A meta- 
evaluation, conducted by Lethbridge School District No. 51, concluded that limited 
changes were being realized by the evaluations. Teachers and school-basc J 
administrators were not actively involved and hence gained little from the exercise. 
A study of the related literature and procedures used in other locations led to the 
development of a "collaborative model" to empower school-based personnel to be 
actively and professionally involved in their school and program evaluations. The 
use of "educational quality indicators" served as a key component of the model. 

Introduction 

In collaboration with twelve Alberta school jurisdictions, tiie objective of tiie 
Alberta Education Educational Quality Indicators (EQI) initiative was to develop 
indicator systems to measure the success of the educational enterprise in the 
province* Indicators provide information to assist in assessing the quality of 
educational programs and the delivery system by focusing on student outcomes. 
The EQI initiative focused on developing indicator systems, establishing 
procedures, and repoiting and disseminating the information to educational 
constituencies in Alberta, 

In recent years, evaluation of teaching and of teachers has received in-depth study 
but litde effort seems to have been put into whetiaer the models and procedures used 
for the relatively new focus on school and program evaluations are consistent with 
/the findings of educational research. Because the stated goal of evaluation is almost 
always school improvement, there is a need to consider and utilize the research on 
quality indicators, school effectiveness, and school improvement. A collaborative 
model should ensure a "buy in" by tiiose involved. This is most important as 
evaluation alone does not cause improvement. 
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In the province of Alberta, as in other Canadian provinces, and a number of 
American states, there has been an increasing emphasis and expectation from 
governments tliat school jurisdictions develop and carry out foimalized procedures 
for evaluation, including the evaluation of students, teachers, progiams, schools, 
and school systems. 

Background 

Administrators and boards need assurance that their models of school and program 
evaluation are consistent with increased effectiveness and school improvement as a 
result of the investments of professional time, cxpeitise, and budget dollars, 
Stufflebeam and Shinkfield (1985) affimied that if evaluations are to be useful and 
provide proper direction and guidance, "the evaluations themselves must be sound" 
(p. 183). In Lethbridge School District No. 51, and indeed throughout much of 
Alberta, the approach used has been predominantly "top down" with the planning 
and procedures carried out almost totally by personnel from the district central 
office and assisted by external resource persons. A meta-evaluation concluded that 
limited outcomes were being realized by the evaluations since the teachers and 
school-based administrators were not actively involved (except for having the 
process "done to" them) and hence gained little from the exercise. A study of 
related literature and of procedures employed in other locations led to the proposal 
for a "collaborative model" and empowering school-based personnel to be actively 
and professionally involved in their program and school evaluations. The use of 
"educational quality indicators" serves as a key component. 

This project involved carrying out a case study of the model of school and program 
evaluation employed in Lethbridge School District No. 51 (LSD No. 51), a medium- 
sized southern Alberta jurisdiction of approximately 8,000 students and 450 
professicmal staff. The Lethbridge model involved the use of a large team (as many 
as 55 people) from the school district central office, other schools. Alberta 
Education offices, other school district central ctffices and schools and the 
University of Lethbridge. These teams would spend up to three weeks on site for 
the school evaluation process. A common concern was whether the model (which 
was extremely expensive in terms of pnDfessional time and expertise) was 
producing payoffs in professional growth and development Perhaps the most 
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significant concern was the problem of implementing the recommendations 
emanating from the evaluation report; members of the district support staff 
(consultants* coordinators, and superintendents) were so heavily involved with 
preparing for and carrying out the evaluations that they had little or no time to 
provide follow-up or assistance with implementing the recommendations made. 

Purpose 

The purpose of the study was to develop a collaborative model for school and 
program evaluations through the use of quality indicators. The following research 
questions were addressed in the study: 

1 . Is the cunent Lethbridge School Disuict No. 51 model for program and school 
evaluation consistent with the literature on indicators of effectiveness, quality 
and school improvement? 

2. Are the procedures, instruments, and data used in the Lethbridge School District 
No. 51 model valid and reliable? 

3 . Does the current literature suggest characteristics or criteria of more effective 
and efficient models for program and school evaluation in terms of indicators of 
effectiveness, quality and improvement? 

4. If the findings for the above indicate ''yes", can the findings be applied to the 
development of a collaborative model for a school system program evaluation 
for the art and/or the school library system? 

Assumptions 

1 . The model for schod/program evaluations previously used was judged to be 
moderately effective and, although it was perceived as resulting in some school 
and program improvement, it was subject to criticism by the stakeholders. 

2. Art programs are often perceived as being difficult to evaluate for several 
reasons: little research is available in this area; teachers, particularly elementary 
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teachers, have little training/expertise in art program evaluation; and because 
there hrs been a general feeling that this evaluation process inhibits children's 
creativity. As a result of these assumptions, the decision was made that the 
system art programs would be one of the programs that the study would 
involve. 

Definitions 

Educational Indicator System: Indicators provide evidence and/or statistics 
that inform policy makers and the public about the condition of the educational 
system and how it is changing. Indicator systems have a wide range of policy 
uses. They can: 

• report the condition of the educational system over time 

• compare the addition of the system with other localities 

• determine the system's progress in attaining certain specified goals 

• assess the implementation of education reform policies by local school 
districts 

• evaluate the impact of policy changes on the system 

• identify potential problems in the educational system 

• explain the causes of various conditions and changes 

• hold teachers, schools and/or school districts accountable for student 
performance (Goertz & King, 1989, p. 23) 

Quality Indicators: These are observable characteristics of excellence established 
through consensus of professional judgement among practicing teachers (Calgary 
Board of Education and Calgary Catholic Board of Education). They specify the 
information that is used to determine the result achieved for each sub-goal. 

System Inputs/Teacher Inputs: Human and financial resources available to 
educaticHi. 

Processes: What is taught and how it is taught. 

Outputs: These are identified as consequences of schooling on students from 
different backgrounds. 



student Outcomes: What follows as a result of the inputs and processes 
involved in a student's educational development These may be cognitive, affective 
or behavioral outcomes and may be recorded as desired or as actual outcomes. 

Evaluation Processes: Measurement of the actual outcomes can be achieved 
through observation (of participation, cooperation, attitude, focus on task, 
initiative, organization, etc.), examination (projects, portfolios, sketchbooks, etc. 
for which specific evaluation criteria have been established), interviews (one-on 
-one, group, conference), surveys, questionnaires, diagnostic testing, and 
evaluation (by criteria, impressionistic/holistic scoring, teacher directed, student 
directed). 

Impressionistic Scoring: Strategies for developing criteria for subjective 
evaluation which allow for obtaining more results in less time. Impressionistic 
scoring may be used at all grade levels and for all subjects. 

Collaborative Model: One which empowers school-based personnel to be 
actively and professionally involved in school eind program evaluations. 

Portfolio: A purposeful, integrated collection of student work that shows student 
effort, progress, or acliievement in one or more areas. The collection includes 
evidence of student self-reflecticm and participation in setting the focus, selecting 
contents, and judging merit Activities are guided by standards. A portfolio 
communicates what is learned and why it is important 

Design 

This project, which took place over a three year period, was designed to identify 
and/or develop a better model for school and program evaluations. 

The collaborative model developed by Lethbridge School District No. 51, 
encompasses an internal evaluation of school/program effectiveness by key 
members within the school community, namely, the administrative team teachers, 
students, and parents. In addition, the model has an external team independently 



validate the self-evaluation of the school community through data collection, 
interviews, etc. 

During the second year of the project, a model for evaluating two programs was 
undertaken. The school library program and the art program were selected to apply 
to the collaborative model and quality indicator research about evaluation and the 
use of indicators of effectiveness and quality. 

Two system coordinating committees were struck to determine the indicators of 
effectiveness of the two programs. Membership came frcnn various stakeholder 
groups representative of the school community-parents, students, teachers, and 
administrators. Each conunittee was asked these basic questions: 

1 . What do you think would be some of the indicators of an effective and 
successful library (art) program? 

2. What would be h^pening in a successful library (art) program? 

3 . What outcomes would tell us if the (library/art) program was highly successful 
and/cx effective? 

An appointed project leader for each program evaluation worked with the 
committees in clarifying, classifying, categorizing, and refining the indicators 
generated by the local coordinating teams. 

Some of the indicators of highly successful and effective library/art programs were 
identified in the literature and shared with the steering committee. From the list of 
indicators generated from the literature and through brainstorming, questionnaires 
were developed for the self-evaluation instrument to be used by the target groups 
within the school conraiunity-teachers (teacher-librarians), administrators, 
students, and parents. The information from the questionnaire comprised the 
internal evaluation segment of the program evaluaticxi. Each group had items that 
cross-referenced the items on the other groups' questionnaire so that perceptions or 
comparisc«is could be made among or between the groups. The questionnaire 
required response ratings to reveal the degree of satisfaction with a jM-ogram element 
or responses about the existence or non-existence of a component of the program, 
whether it be in the form of resources (human or material), instructional planning, 
etc. 
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The self-evaluation questionnaire was completed by all stakeholder groups within a 
two-to-three week period and the results were sent to the central office where the 
results were tabulated for each respondent group. Both school-based results and 
total system results were compiled and made available to the extemal evaluation 
team which visited all schools as a team, interviewed students, teachers and 
administrators, and visited classrooms, looking at resources and other sources of 
evidence to support the results of the school-based self-evaluation. 

Initially, questionnaires for the Art and Library Program Evaluations were 
distributed to 100 teachers/administrators, 1,700 parents (1-6), 500 parents 
(secondary), 3,100 elementary students, and 1,275 secondary students. Table 1 
presents the response rate for each questionnaire. 

Table 1 

Response Rate for the Art and Library Program Evaluations 



Questionnaire Distribution Respondents % Response 



Art Program Evaluation 

Teachers/Administration 100 94 94.0 

Parents (1-6) 1,000 918 91.8 

Students (1-3) 850 811 95.4 

Students (4-6) 900 872 96.9 

Parents (7-12) 300 256 85.3 

Students (7-12) .400 378 945 

3,550 3,329 93.8 

Library Program Evaluation 

Elementary parents 700 598 85.4 

Secondarj' parents 200 156 78.0 

Elementary students 1,350 1,265 93.7 

Secondary students _M1 839 

3,125 2,858 91.5 
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Following the compilation of the data, the results were analyzed. The external team 
compared the evidence it gathered with the perceptions of the school conununity. It 
also drew some conclusions about the quality of the evaluated program for the 
entire system. A status report on the effectiveness of the art/library programs 
within the school district was written and presented to the Board of Trustees. In 
addition, the committee made the necessary corrections^tevisions to the model, and 
the project leader developed a school-based report to share with each school. This 
report showed: the perception of the school program from the perspective of the 
various stakeholder groups in relation to the indicators of effectiveness; the findings 
of the external team in the form of commendations and recommendations; and the 
system program evaluation data. At this time a plan of action for schools was 
initiated 

Delimitations 

1 . Chily the art and library programs were evaluated. 

2. Only one class at each grade level in each school was surveyed. This decision 
was reached by the art committee who recognized diat there was insufficient 
staff available to tabulate and analyze a total system survey. 

Limitations 

The lack of training and experience of the project leaders in data collection and 
analyses procedures were cause for concern in the early stages of the art and library 
program evaluations. The data analysis was further hampered by the loss of much 
of the information collected from the surveys. This loss precluded any further 
analyses of the data. 

A change of personnel duiing the second year of the project resulted in some 
valuable time being lost while the staff assuming the responsibility responded to 
their new role. By the time focus and direction were reestablished aiere was a 
general feeling that timelines were short for the completion of the project The 
services of a person experienced in statistical analysis would have been an asset to 
the project and would have assisted not only in saving valuable time but also in the 
preparation and presentation of statistics to validate the report 
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Overview 

This first chapter has presented background information on the purpose of the 
study, some assumptions, definitions, and the design of the project with some 
delimitations and limitations included* 

An overview of the related literature used in both the initial research component of 
the project as well as the literature relevant to the specific programs is presented in 
Chapter 2. 

Chapter 3 presents the major data source, collection procedures, and data analysis. 
Chapter 4 describes the case study research, the application to the art program and, 
the application to the library program. A comprehensive description of each is 
included. The results of the studies are discussed in Chapter 5. 

Chapter 6 presents the summary and discussion. It reviews the purposes and 
findings of the project and discusses what conclusions can be drawn and the 
implications of the product Also included in this chapter is the proposed follow-up 
by Lethbridge School District No. 51 in regard to further development and 
application of the project. 
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Chapter 2 
Related Literature 

Wamica reviewed four major areas of educational literature which formed the basis 
for his study and proposed model: school and program evaluation - theory and 
practice, effective schools research, indicators of effectiveness or quality, school 
improvement literature, and evaluation models, criteria, and standards. 

Purposes of school and program evaluations were clearly stated by Stufflebeam 
(1971) as "not to prove but to improve!" The literature reviewed revealed 
consistency in the view that schools and programs should be evaluated. Both 
Eisner ( 1985) and Goodlad (1984) stressed the lack of public confidence in oui* 
schools. Common ( 1987) concluded: "There is rightfully a justification for careful 
evaluatic«i of the curriculum, the professionals and students, and the organization 
that constitutes public education" (p. 15). In considering the nature of the 
evaluations and what should take place, Stufflebeam and Shinkfield ( 1985) reported 
that Ralph W. Tyler, who is generally recognized as the founder of educational 
evaluation, considered that evaluation should determine the congruence between 
performance and objectives. This approach laid the foundations for an objective- 
oriented style of evaluaticMi. 

Meta-Evaluation: Evaluating the Evaluation 

Scriven (1976) and Stufflebeam (1971) discussed "meta-evaluation" and the need 
for assessing evaluation criteria, processes, and techniques. Scriven ( 1976) 
stressed the fact that evaluators have a professional obligation to ensure that their 
evaluations are subjected to competent evaluation. Scriven viewed evaluation as 
involving multiple dimensions and employing multiple perspectives, utilizing 
multiple levels or measurement and making use of multiple methods. 

Morgan ( 1986) asserted that no one should be immune from evaluation. Levin 
(1983) concurred and noted, "Given the amount of time, effort, and money which 
may be involved in an evaluatic«i, and the importance which its results may have, 
school districts need to be sure that evaluations do 'deliver tiie goods'" (p. 35). 
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Common (1987) identified a number of concerns about evaluation as it is now 
done. She opposed external models for evaluation because they are cosdy, 
contentious, lower teacher morale, and generate data which may be used very litde. 
Her view is that external models of evaluation may stop curriculum innovation and, 
at best, are unlikely to make it start (pp. 11-15). 

Stufflebeam and Shinkfield ( 1985) reported that Tyler considered that evaluation 
should determine the congmence between performance and objectives. This 
approach laid the foundation for an objective-style of evaluation as far back as 1942 
(pp. 70-74). 

In considering the "how" of evaluation, Eisner (1979) expressed his strong view 
that procedures and criteria used to evaluate students, teachers, and school 
administrators "have profound effects on the content and form of schooling". He 
seemed, to lend considerable support to the argument for school-based evaluation 
with his statement, "The school is the basic unit of educational excellence"(p. 267). 
Goodlad (1984) offered some related strategic advice when he stated the "efforts at 
improvement must encompass the school as a system of interacting parts, each 
affecting the others" (p. 86). 

Herman (1986) suggested a model involving a "top-down, bottom-up" approach. 
She noted the main problem with existing "top-down" nKxlels was that the people at 
the bottom (teachers and local administrators) were seen as data providers rather 
than data users and that paperwork and bureaucratic burdens intruded into, rather 
than supported, school operations and improvement efforts. "Bottom-up" needs 
were not being met 

Toffler (1980) and Eisner (1985) provide compelling rei^sons for a model which 
involves rmrc active and professional participation of school-based personnel. The 
empowerment of school-based teachers and administrators, and the school as the 
focus of action and development offer the greatest potential for real growth and 
development of the school, its staff, and its programs for students. 
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Effective Schools Research 

To a certain extent, research on effective schools had its origin somewhat in 
response to the well-publicized works of Coleman (1966) and Jencks (1973). They 
held a very pessimistic view that schools could do very little to reduce ^parent 
inequality among children in terms of achievement 

Edmonds (1979) showed that some schools succeed where others fail and identified 
five characteristics of successful schools: principals who provide strong 
administrative and instructional leadership, high expectations that all students can 
and will leam, a school climate that stimulates learning, students and staff who 
believe basic skills are urgently important, and a continuous system of monitoring 
student progress. The major importance of school leadership was reiterated by both 
Goodlad (1984) and Rutter, Maughan, Mortimer, Ouston, and Smith (1979). Over 
tlie decade of the 1980s, a body of literature known as "effective-schools research" 
developed, producing a remarkably consistent set of findings. Purkey and Smith 
(1983), after a wide review of studies, concluded that the findings of recent school- 
effects research contradict the conclusions of Coleman (1966), Jencks (1973), and 
others. Schools can make a difference. Wamica (1990), after a thorough review of 
the literature, and based on lengthy career experiences, concluded that the decision 
on die debate related to the external versus internal evaluation model falls clearly on 
the side of die school-based model. The convincing arguments of Boud and 
Donovan (1982) and Common (1987) strongly supported this conclusion. 

Of significant interest is that not all researchers and writers on the topic are 
committed to the effective school philosophy; some criticisms have emerged 
Glickman (1987) argued that schools and researchers have failed to distinguish 
between good and effective schools and that, "The 'effectiveness* movement is 
unnecessarily restricting the curriculum, narrowing the teaching approach to direct 
instruction, and controlling teachers" (p. 624). Cuban (1984) also identified 
problems with the effective schools research: no one knows how to create effective 
schools, the language is fiizzy, effectiveness is constricted to test results, and most 
research was done in elementary schools (p. 129). Fullan (1985) cautioned tiiat 
"nothing would be worse tiian establishing a grand scheme putting all schools in the 
district through the paces of developmg effective school plans" (p. 414). 
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It is evident that evaluations of programs and schools must look well beyond the 
criteria commonly associated with the effective schools movement. Evaluations 
must be broadly based and multidimensional. 



Indicators of Effectiveness or Quality 

A new body of literature is beginning to evolve and offers promise as a means of 
describing effectiveness and quality in education. The development of "indicators" 
is providing a new focus and emphasis in educational studies and in schools. 
Common (1987) described quality in education, Mumane and Pauly (1988) 
stressed the importance of developing multiple indicators, and Kaagan and Smith 
(1985) pointed out that indicators provide infonnation about the health of a school 
system but cautioned that a common set of indicators would also increase the move 
toward centralization. 

The Colorado Department of Education ( 1982) presented indicators of quality in 12 
categories, with a total of 42 indicjitors. This list bears a striking similarity to the 
effective-schools criteria previously discussed in the review of literature. 

In both Alberta and British Columbia, considerable efforts are continuing in this 
area. The evaluation model presented by the British Columbia Ministry of 
Education ( 1986) cc»isists of three ccxnponents: goal statements, quality indicators, 
and an interpretive framework. McEwen and Zatko ( 1989), m belialf erf" Alberta 
Education, provided examples of indicators of students* cognitive, affective, and 
behavioral outcomes as well as indicators describing the educational context, 
inputs, and processes. 

The Minist^re de l^Educaticwi, Gouvemement du Quebec (1989), published a set of 
indicators as c»ie means of responding to the demand of accountability in public 
administratic«i. These indicators were presented in five categcdes: 

1. Financial resources, including spending in relation to GNP, school board 
spending per student, student- teacher ratio, and average teacher salaries. 

2. Progress through school, measured by numbers reaching and completing 
secondary school, falling behind, or dropping out of school. 

3. Evaluation of learning, such as secondary school examination results by sex, 
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school system, language of instruction, type of education, and considering 
regional disparities, and subjects. 

4. Secondary school graduates in terms of numbers and types of diplomas, 
numbers going on to college, and numbers joining the work force. 

5 . Adult education including spending by board, and numbers of adult graduates. 

The American Office of Educational Research and Improvement (1987) identified 
the following outcomes as indicators: reading performance, writing performance, 
college-entrance examination scores, high-school completion by race and ethnicity, 
literacy skills of your adults, and participation of high school graduates in 
postsecondary education. Resources such as expenditures per pupil were listed as 
well as the "ccMitext" indicators (for example, home environment). 

School Improvement 

Since the goal of school and program evaluation is the improvement of schools, it is 
important to consider the literature on improvement Qose similarities exist 
between the findings and the research on effective schools. 

Leithwood and Fullan (1984) proposed six strategies for increasing the chance of 
successful change: continuous professional development, increasing principal 
effectiveness, school planning, developing policies with a view to their 
implementation, using standard operating procedures, and building systematic 
problem solving procedures. 

Fullan (1985) went even further and presented a set of school-level strategies. This 
included developing a plan, investing in local facilitators, allocating resources, 
selecting schools, and deciding on the scope of the project, developing the 
principal's leadership role, focusing on instruction, stressing ongoing staff 
development, ensuring information gathering and use, planning for continuation 
and spread and reviewing the capacity for further change. 

Lezotte and Bancroft (1985) noted that successful local school improvement 
programs have in common a focus on a single school, a building-based 
improvement team, a longer-term orientation (three to five years) in planning and 
implementation and are organized around the concept of the effective school. 
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Wood, Freeland, and Szabo (1985) noted the present thrust for school 
improvement differs from the past in that the target is no longer the district or 
individual staff member, but the school. They concluded tliat the primary method 
of achieving improvement is not curriculum development but staff development; 
that the source of improvement is not just intuition but research on effective schools 
and effective instructional practices and that planning is no longer year-to-year 
responding only to immediate needs, concerns, and problems, but is proactive, 
long range, and systematic, 

Naisbitt ( 1982) appeared to lend support to this school-based model erf* 
improvement with his statement Trends are bottom-up, fads top-down". He 
advocated moving away from the specialist who is soon obsolete to the generalist 
who can adapt to a "high-tech/high-touch" worid. Although he was mainly 
referring to business, Naisbitt*s opinion that, "long-range plans must replace short- 
term profit", could apply equally to school (p, 82). He declared that "strategic 
planning is worthless unless there is first strategic vision" (p. 94). Naisbitt's view 
that "Followers create leaders. Period" (p. 101) summarizes the change in focus. 

According to the Saskatchewan Minister's Advisory Committee (1985), the impetus 
can come from outside the school but planning and action must occur within. 
"School improvement is taking action at the local level" (p. 7). 

External versus Internal Evaluation 

Goodlad (1984) addressed the issue of external versus internal evaluation with his 
statement, "the approach having the most promise is one that will seek to cultivate 
the capacity schools to deal with their own problems* then become largely self- 
renewing" (p. 31). 

The school-based approach model was supported by Eisner (1985), Good and 
Brophy (1986), and Morgan (1986) who concluded tliat the most successful 
systems of evaluation are likely to be based on a collaborative approach since it 
assures acceptability which may be more crucial than validity and reliability. 

Shaw (1988) believed that after a thorough self-study is undertaken and 
accomplished, visiting team members could serve as external validators for the 
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work of the local staff but cautioned, that school evaluators should recognize they 
cannot learn as niuch during the three-day visit as local staff members already know 
about their school program. 



Novak (1985) ascertained that too much stress, time, and money are invested in the 
formal preparation and visit involved in external evaluations, even though agreeing 
that schools could benefit from some periodic outside review. 

Other researchers advocating the value of internal evaluators include Boud and 
Donovan (1982), Herman (1986), and Wilcox (1989), In British Columbia, the 
Ministry of Education developed procedures for accreditation which serve the 
school and program evaluation function since accreditation is defined (1983) as "the 
outcomes of an internal and external evaluation" (p, 2), Internal evaluation is 
undertaken by the staff and administration within the school and is designed to 
encourage and assist in the improvement of the school by its own initiative and 
effort External evaluation is undertaken by an external committee and is designed 
to provide an evaluation in a broader frame of reference to confirm or question the 
internal evaluation. 

After a thorough review of the Uterature, and based on his previous experience and 
training, Wamica (1990) concluded that "the empowerment of school-based 
teachers and administrators, and the schools as the focus of action and development 
offer the greatest potential for real growth and development of the school, its staff 
and its programs for students" (p, 15), 



Application to the Art/Library Program Evaluation Models 

The research and the findings of Wamica*s study provided the basis for the 
development of the art and library program evaluations. In addition, the developers 
reviewed the literature pertaining specifically to the development of quality 
indicators, outcomes-based education and references to results-based approaches as 
identified by Kaufman (1988), Prinnary references for the art program evaluation 
were the Alberta Art Program of Studies for elementary (1985), junior high (1984), 
and senior high (1986) schools. Attention in these documents focused on the 
philosophical base and on the knowledge, skills, and atntudes outlined The Focus 
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on Learning: Integrated Program Model for Alberta School libraries (Alberta 
Education, 1985) was used in the development of the Library Program Evaluation 
model. 
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Chapter 3 
Design 



Evaluation of the Former Model 

Wamica's case study looked at the former Lethbridge School District No. 51 school 
and program evaluation models. The results of his research were applied to the art 
ar'^ library programs. These programs field-tested a model based on the results of 
his study. Subsequently, a generic collaborative model was developed to overcome 
the perceived deficiencies of the former "tq)-down" approach. 

For the type of naturalistic research being done in both the initial study and the 
subsequent application to the two programs, a qualitative case-study design, 
supplemented by some limited statistical analysis, was the preferred mode. 
Patton*s (1980) observation that "researchers usmg qualitative methods attempt to 
understand programs as a whole" would support this approach (p. 40). 

The Lethbridge study made use of large quantities of data that had been collected 
over a three year period of school and program evaluations, using instruments 
designed by Lethbridge School District No. 51 but similar to those used in other 
districts in Alberta and by Goodlad (1984). The mitial Lethbridge results as 
outiined in Wamica's case study were compared to the findings of Goodlad. 

The Lethbridge model qjpears to meet Goodlad*s (1984) assertion that efforts at 
"school improvement must encompass the school as a system of interacting parts 
each affecting the other" (p. 31). The broadly based emphasis of the model with 
focus on all aspects of the school ranging from instructional programs to non- 
instructional programs acknowledges that each part of the school's operation affects 
all otiier aspects (Wamica, 1989, p. 105). 

In Wamica's case study, a Pearson r coefficient of correlation was computed on the 
ratings of the researcher and the "panel of experts". This panel was composed of 
four school principals who were chosen because they were familiar with all aspects 
of the evaluation process and had participated in it The correlation was computed 
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to be 0,6 which can be interpreted to be a "high" relationship according to 
Morehouse and Stull (1975, p. 198). 

Wamica and the panel checked for inter-subject validity verification in order to 
control the possibility of researcher bias. The data collected from students, 
teachers, and parents was analyzed to check for degree of association using Peai son 
Product-Moment Correlation Coefficients and also compared with data from the 
Goodlad (1984). An analysis showed the areas of greater agreement between the 
researcher and the panel of experts who gave highly positive ratings to statement 
covering several aspects of the process. These included communication with the 
evaluation team, opportxinity for parental input, recommendations wiiich were 
reasonable and accurate, an evaluation report which was presented in draft form to 
the school prior to its finalization and release, and the fact that the school developed 
a plan to respond to recommendations. Similar agreement existed in terms of the 
present model being predominantly "top down", and the need for greater 
involvement of teachers and school-based administrators. Both the researcher and 
the panel gave low ratings to the attention paid to school social inputs and to the 
clarity of the evaluator's role after the report was written. 

The researcher was much less positive than was the panel that the input of school 
administrators and teachers in the original model was adequate. Close agreement 
existed between the researcher and the panel in a number of other areas. The 
usefulness of the evaluation report was rated fairly highly by each. 

The approach to school and program evaluation as used in the Lethbridge models 
encompasses virtually every one of the indicators df effectiveness presented by 
Squires et al (1983) in their questionnaire for assessing school and classroom 
effectiveness. The Lethbridge model appears to meet Goodlad's (1984) assertion 
that efforts at "school improvement must encompass the school as a system of 
interacting parts each affecting the other" (p. 31). The broadly based emjrfiasis of 
the model with a focus on all aspects d[ the school ranging from instructional 
programs to non-instructional programs acknowledges that each part of the school's 
operatic^ affects all other aspects. 



The Lethbridge model developed by Wamica adequately addresses many of the 
checkpoints of the Key Evaluation Checklist developed by Scriven (1976) in temis 
of description, clients, function, consumer, process, outcomes, generalizability, 
significance, and reporting. In the view of the researcher and confirmed by the 
panel of experts, there are some problems with the delivery system, the standards 
by which programs are evaluated (the lack of a clear set of ip'iicators of educational 
quality), the usefulness of the outconaes (since there are problems in implementing 
recommendations), the costs, and the thoroughness of the meta-evaluation. 

The lack of absolute standards by which programs can be compared and assessed is 
a weakness of the Lethbridge model. Another area where the Lethbridge model is 
weak, according to the "E Standards" as produced by North Central Association 
Commission on Schools (1987-88), is in teacher involvement in assessing the 
effectiveness of the program and planning for its inq)rovement The school 
evaluation procedures in Lethbridge placed teachers who provided littie meaningful 
involvement in determining the nature of desirable changes, as recipients of the 
process. Teacher involvement came only after the external evaluators had 
determined what changes should be made. The collaborative evaluation model 
includes procedures to check that the characteristics common to effective schools 
are in place. 

The lack of clearly established and accepted indicators of educational effectiveness 
or quality in the Lethbridge approach to school evaluation was one of the major 
weaknesses identified by Wamica. Although many of the qualitative and 
quantitative indicators may be inferred in the Lethbridge models, they were not 
specifically identified and looked for as part of the evaluation. Littie emphasis was 
placed on interpretive indicators of context, input, and process, or on outcome 
indicators of the cognitive, affective, or behavioral nature. A set of standards o]- 
basis for comparison was absent. The result was that judgements were made about 
program quality and effectiveness without the strength of a set of agreed-upon 
standards. 

The literature on school improvement leads to some criticism of tiie school 
evaluation model in question. The concerns of Leithwood and FuUan (1984) have 
not been addressed adequately. They believed that successful change involves 
pressure gradually acquired through interaction with peers and other leaders, not 
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mandated by authority. The Lethbridge evaluation model placed emphasis for 
change from the pressure brought about by the evaluation report instead of from 
interaction with peers. The Lethbridge School District No. 51 approach did not 
utilize the suggestions of Landon and Shirer (1986) in the Wisconsin School 
Evaluation Han to have the school conduct a self-evaluation which is then audited 
by an outside team. Similarity, the collaborative planning as espoused by 
Patterson, Purkey, and Parker (1986) was not evident 

Wood, Freeland, and Szabo (1985) recommended a focus on staff development 
instead of the traditional emphasis on curriculum development, and for planning 
that is proactive, long range, and systematic. The Lethbridge evaluation model was 
not consistent with the suggestions of these and several other researchers in the area 
of school improvement 

The findings from this research led to the development of the collaborative model. 

Change of Focus 

Although the intent of the original research was to focus on school evaluation^ 
system senior administration and the board trustees directed the move toward 
pro gram evaluation Using the study by Wamica as a basis of information, work 
then proceeded on the application of this research to the development of a 
collaborative model for art and library program evaluations. These programs were 
selected for a number of reasons: the system perceived need to evaluate the 
effectiveness of these programs; availability of central office leadership; and in 
regard to the art ixogram, a perceived lack of teacher expertise in art evaluation due 
in part to the difficulty encountered in obtaining subject-specific informaticxi in this 
area. Acting upon reconunendations frcwn the administration, the board of trustees 
^proved the development and implementation of a new evaluation format 

Steering committees were organized for each of these program areas. Meetings 
were held in which the committees were given instruction and direction on the 
development of quality indicatc«^ which guided the wc«-k of both committees. As a 
result o( staffing changes, identified system needs, and the availability of time, the 
art program became the focus for the final stages of the project Wcwrk continued 
through the various steps outlined in the Art Program Evaluation Flow Chart 
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(Figure 1). Questionnaires were developed for the following stakeholder groups: 
Teacher/Administration; Parents Grades 1-6; Students Grades 1-3; Students Grades 
4-6; Secondary Parents; Students Grades 7-12. (See Appendix B). Prior to the 
disiribution of these forms to the schools, they were reviewed/validated by other 
teachers, system administrators and the Parent and Student Advisory Council. 
(Following direction from the Parent and Student Advisory Council, questionnaires 
for non-art students at the secondary level and their parents were developed. The 
response to these questionnaires was very poor making it impossible to provide any 
valid data,) The committee continued work on the identification and verification of 
the student outcomes as well as the re-examination and modification of instruments 
used to identify system and teacher inputs. Assessment tools and processes were 
identified, developed, and/or refined. A follow-up questionnaire was developed 
and distributed to stakeholder groups to ascertain whether the new program 
evaluation model was perceived as an improvement over the previous model. If so, 
why was it regarded as an improvement and, would the resulting action plans have 
a positive impact on the program? 

Modifications were made to the art evaluation flow chart with the addition of the 
follow-up questionnaire and the reversal of the final steps as the system action plan 
was implemented prior to the completion of the EQI report 

Work is continuing on the project in an effort to verify that the processes are both 
adequate and accurate. The focus of this work is to: (1) ensure that there is 
congruence between desired and actual student outcomes, and (2) verify that the 
use of the new naodel ensures ongoing improvement in program evaluations and in 
the achievement of desired student outcomes. 
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Figure 1 : An Program Evaluation Flowchart 
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Chapter 4 



Development of the Model 

Wamica ( 1989) discussed the effectiveness of system/program evaluation, 
conducted a review of current related literature, and, as a result of his case study, 
defined the criteria for a more effective model of school and program evaluation 
with emphasis on the development of education quality indicators. The findings of 
his study were then applied to evaluating two school system programs: the art and 
the library. 

1991 Art and Library Evaluations 

Purposes 

1 . To appdy Wamica's model to specific programs. 

2. To identify quality indicators for the programs. 

3 . To identify and/or develop assessment procedures for the verification of the 
indicators. 

4. To gather information as to the stakeholders' (school staff, administration, 
students, parents) perception of the effectiveness of these programs in each 
school and in the district as a whde. 

5. To provide assistance for teachers, particularly at the elementary level, by 
identifying the quality indicators for art and by providing suggestions/examples 
of assessment procedures. 

6. To develop an action plan for improving the art and library programs in the 
schools and the district 

Procedures 

A steering committee was OTganized and a number d meetings held during which 
instruction/direction on the meaning of and the identification of quality indicators 
was given. This ccwnmittee of internal and external evaluators was composed of 
teachers, administrators, and an Alberta Education consultant; it included generalist 
and specialist teachers from elementary and secondary schools. The committee 
identified and developed: 
a) quality indicators for the art programs 
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b) questionnaires for the following target audiences: 

• teacher/administrators 
•parents 1-6 

• students grades 1-3 

• students grades 4-6 

• parents 7-12 

• students 7-12 

and acting upon a recommendation firom the Parent/Student Advisory Council, a 
questionnaire for non-art students and their parents at the secondary level 
(Appendix B). 

c) the implementation format for the evaluation process within the parameters 
previously identified 

Before distributing the questionnaires, the evaluation package was presented to 
school district administrators for validation and staff information. Data from the 
questionnaires were compiled and summaries prepared prior to the school 
visitations by the external evaluation team. 

Following the school visits a team perception check was held. The steering 
committee used the information from the questionnaires and the findings of the 
evaluation team to formalize the report. This report, which included both individual 
school and system information, was presented to the board of trustees. 
Subsequentiy action plans were developed in response to the report at both the 
system and individual school level. Woik continued on the refinement of the art 
program evaluation model. This included the identification of quality indicators of 
desired student outcomes as well as the procedures to use indicators in evaluating 
the effectiveness of programs. Assessment procediu^s to measure student 
outcomes were identified and/or developed. 

The key component in the development of educational quality indicators, as 
identifiedA^erified by the steering committee and the stakeholder groups, is the 
collaboration between school-based and district-based staff working together to 
determine comparators/indicators (which focus on student outcomes in the 
cognitive, affective, and behavioral domains). These must all be developed within 
an interpretive framework which places emphasis on context, inputs, and process. 



Discussion 

The art survey included specific areas common to all the questionnaires 
(Appendix B) about which information was being garnered. Some of the major 
types of questions related to the importance of art as a program, facilities, 
budget/equipment/supplies, art instruction, activities. The following table 
highlights some common questions for the different respondent groups. 

Table 2 

Common Questions for Respondent Groups in the 
1991 Art Evaluation 



Question Teachers/ Students Parents 

Administrators 

1-3 4-6 7-12 



importance 


1 


2,3 


facilities 


2 


2 


resources 


3 


3 


instruction 


4 


4 


activities 


5 


1,7,8 


enjoyment 


9 


9, 12 


group effort 


12 


12 


perceived ability 


10 


10, 14 



2,3 


2,5 


2, 5, 11 


3 


1 




2,8 


2,3 


7 


4, 11, 15 


4, 10, 11, 


1, 3 




12, 14, 15 




1,7,9,11 


7 


8 


8 


8,9 


6,9 



10 

10, 14 16 4, 12, 13, 14 



As very good ait facilities are provided in the secondary schools in Lethbridge 
School District No. 51, no questions in this regai*d were included on either the 
student or parent survey. 

Findings 

The steering committee perceived that administrators, teachers, students, and 
parents consider art as an important ccnnponent of the school program. The results 
of the questionnaires confirmed this perception. 
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Even though art is considered important, there is no system statement that would 
provide ongoing support, focus, and direction for the art program. Such a 
statement could have reference to the contribution the study of art makes to the total 
education of the child, i.e, its emphasis on: critical thinking and problem-solving 
skills; communication skills; and promoting a better understanding of and 
appreciation for art and artists across cultures and across time. 

The following topics were examined under the broad heading of planning and 
organization: 

• sense of direction, focus, purpose 

• objectives, concepts/skills, sequencing 

• instructional techniques, activities 

• resources 

• evaluation 

• integration and co-operative planning 

• budget and facilities 

The survey results found evidence of in-depth planning but it was not consistent 
either within all schools or across the system. Only 28% of teachers using a self- 
rating indicated a very high adherence to the Program of Studies and confidence in 
their long-range and unit planning. 

Generally, the respondents were satisfied with the categories of budget, equipment, 
and supplies. Storage space and student work areas were identified by 35% of the 
elementary teachers/administrators as in need of improvement. 

As predicted by the steering committee, evaluation procedures were identified as an 
area of concern. Thirty-three percent of the students did not know how their report 
card maik was established. Only 7% of the students indicated a clear 
understanding; 80% of the parents were not aware of how their child was being 
evaluated in art and 37% of teachers indicated problems with evaluation procedures. 
Forty-eight percent of the teachers indicated that they felt their training was 
inadequate for the presentation of a balanced art program. 

These findings partially substantiated the original prenriise regarding teacher 
expertise, particularly in regard to evaluation procedures. 
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A follow-up questionnaire and the preparation of program action plans confirmed 
tiiat tiie collaborative model was preferred and that the identification of quality 
indicators were considered essential components of the evaluation process. 



Information on the questionnaires and the results of the library evaluation can be 
found in Appendix D. 

Unfortunately, the original data that had been collected were erased, making further 
analyses difficult. However, a summary of the data collected from the various 
target audiences can be reviewed in the Art Program Evaluation and the Library 
Program Evaluation (see Appendices C and D). 
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Chapter 5 



A Collaborative Model for School and Program 

Evaluation 

The case study (Wamica, 1989) found that the Lethbridge model for system 
evaluation satisfied many of the criteria of effectiveness, quality and improvement 
in terms of receiving input from all stakeholders, utili2dng an evaluation team with 
expertise and credibility, and using a multidimensional focus to examine a broad 
range of both instructional and non-instructional aspects of the school. However, 
tiie model was judged by the researcher to have limitations in that it was "top- 
down" with little opportunity for meaningful participation and professional growth 
by the school staff and administration. There are strong doubts as to whether the 
infonmtion gained from the model is of sufficient value related to professional 
growth and improvement to warrant the heavy costs of human resource time and 
energy. A major weakness of the model is the lack of clearly established and 
accepted sets of standards or indicators of quality. Concerns with the ability of 
schools to implement the recommendations leads to serious questions about 
whether significant improvements come about. 

Wamica's case study determined that the procedures ana instruments in place had 
strong face, content, and construct validity. No attempt was made to demonstrate 
external validity since the purpose was not to generalize the conclusions reached at 
one school to another one. Some doubts about reliability and validity were raised 
since the items were not field-tested and some items were changed from school to 
school with loss of comparability of certain results. Although reliability (intemal 
consistency or stability) was never calculated, the instmments appear to be 
consistent as indicated by the high correlations which were found. 

The literature was clear that there are certain criteria and characteristics which could 
be incorporated into the Lethbridge school evaluation procedures to increase 
effectiveness and efficiency: 

1 . The new model should move away from the heavy emphasis on a "top-down" 
approach to encourage and empower school staff and administrators to be 
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actively involved and interacting in assessing the effectiveness of their own 
programs and planning for their improvement A model involving a better 
balance between internal and external evaluation should be considered 

2 . Tlie development of a clear set of standards or indicators of educational quality 
would be a desirable step in moving the evaluation model onto more abjective 
ground, and would allow change, and the flexibility to adapt it to individual 
circumstances; change does not come from externally imposed procedures 
(Fullan, 1982). School evaluation should be a continuous process. Schools 
need to identify areas requiring improvement to work actively toward this end. 
Empowerment of school-based staff and administration is fundamental to 
reviewing and improving schools. 

Application to Lethbridge School District No. 51 

School and Program Evaluations 

A more effective model of program evaluation through the use of quality indicators 
was developed for the art and library programs. Because of the collaborative nature 
of this approach, there was a "buy in" by tiie stakeholder groups. The result has 
been that each school is beginning to evaluate its own educational quality and 
effectiveness in a professional manner which serves to empower school-based staff 
and contributes to meaningful and effective school growth and improvement 

Art programs are frequendy perceived as being more difficult to evaluate, both as a 
result of little available research in this area as well as the fact that generalist 
teachers have little or no training/expertise in the area of art evaluation. There has 
been a perceptiion that evaluation of a child's art inhibits creativity. A follow-up 
questionnaii'e to the evaluation confirmed that the application of the collaborative 
model and the subsequent identification of quality indicators resulted in a positive 
attitude change in teachers. 

Figure 2 identifies inputs and processes. The desired student outcomes as well as 
suggested assessment procedures are outlined. This is basically a generic model 
that could be readily adapted to any subject area with few modifications. 

Figure 3 indicates a further development/refinement of the model. 
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Based on current literature and the practical application of the proposed model 
during the Lethbridge School District No. 51 evaluations, stakeholder groups have 
confirmed that a more effective collaborative model, involving the development of 
educational quality indicators has been designed, implemented. (Further 
refinements will be ongoing). The development of a clear set of standards or 
indicators of educational quality is a desirable step in moving the evaluation model 
onto more objective grounds. This process will allow much more professional 
involvement of school-bascxl personnel. Although the art program evaluation was a 
practical application of the research, the model that has been developed could be 
applied, with few modifications, to other subject areas. Ccramunity/stakeholder 
groups' involvement in the evaluation process has proven to be very valuable and 
should be continued/estabhshed in school jurisdictions. The ''buy in" that this 
provides is essential. 
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Chapter 6 



Summary and Discussion 



In recent years there has been a marked increase in the emphasis and expectations 
for program and school evaluations. Throughout much of Alberta, the approach 
used has been predominantly a "top down" process with the planning and 
procedures carried out almost exclusively by personnel from Alberta Education or 
district central offices with assistance by external resource persons. A meta- 
evaluation, conducted by Lethbridge Schod District No, 51, concluded that limited 
changes were being realized by the evaluations since the teachers and school-based 
administrators were not actively invdved (except (gc having the process "done to" 
them) and hence gained little from the exercise. A study of the related literature and 
procedures used in other locations led to the proposal for a "collaborative model" 
which would empower school-based personnel to be actively and professionally 
involved in their school and program evaluations. The use of "educational quality 
indicators" would serve as a key component of the model. 



The evaluation of teaching and of teachers has received inniepth study but little 
effort seems to have been put into whether the models and procedures used for the 
relatively new focus on school and program evaluations are consistent with the 
findings of educational research. Because the stated goal of evaluation is almost 
always schod improvement, there is a need to consider and utilize the research on 
quality indicators, school effectiveness, and school improvement. A collaborative 
model would ensure a "buy in" by those involved. This is essential as evaluation 
alone does not cause improvement 

In the province of Alberta, as in other Canadian provinces and a number of 
American states, there has been an increasing emphasis and expectation from 
governments that school jurisdictic»is will develop and carry out formalized 
procedures for evaluation, including the evaluation of students, teachers, programs, 
schools, and school systems. 



Rationale 
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The Lethbridge mcxlel involved the use of a large team (up to 55 persons) from the 
school district central office, other schools. Alberta Education offices, and the 
University of Lethbridge, spending up to three weeks of lime on site for the school 
evaluation process. A common concern was whether the model (which was 
extremely expensive in terms of professional time and expertise) was producing 
payoff in professional growth and development. Perhaps the most significant 
concern was with the problem of implementing the recommendations emanating 
from the evaluation report 

Administrators u^\d boards need assurance that their models of school and program 
evaluation are consistent with increased effectiveness and school improvement as a 
result of the investments of professional time, expertise, and budget dollars, 
Stufflebeam and Shinkfield (1985) affirmed that if evaluations are to be useful and 
provide proper direction and guidance, "the evaluations themselves must be sound" 
(p. 183). 

Purpose 

The purpose of the Lethbridge School District No. 51 project was to develop a 
more effective model for school and program evaluation. Consequently, the 
following research questions were addressed: 

1 . Is the current Lethbridge School District No.51 model for program and school 
evaluation consistent with the literature on indicators of effectiveness, quality, 
and school improvement? 

2 . Are the procedures, instruments, and data used in the Lethbridge School District 
No.51 model valid and reliable? 

3 . Does the current literature suggest characteristics or criteria of more effective 
and efficient models for program and school evaluation, in terms of indicators 
of effectiveness, quality, and improvement? 

4. If the findings for the above indicate "yes", can the findings be applied to 
the development of a collaborative model for a school system program 
evaluation for the art and/or the school library program? 
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Design 

Wamica ( 1989) completed a case study of the Lethbridge model for school and 
program evaluation. It was primarily qualitative in nature, but included some 
correlations. The major areas of educational literature reviewed as a basis for this 
study and the proposed model were: school and program evaluation - theory and 
practice; effective schools research; indicators of effectiveness or quality; and, 
evaluaticm models, criteria, and standards. 

After his review of the literature and based on career experience, Wamica (1990) 
concluded that the decision on the debate related to the external versus internal 
evaluation model falls clearly on the side of the school-based model The 
convincing arguments of Boud and Donovan (1982), Common (1987), Hermai: 
(1986), Toffler, (1980), and Eisner (1985) provide sound reasons for a model 
which involves more active and professional participation of school-based 
persormeL The empowerment of school-based teachers and administrators, and the 
school as the focus ci action and develq)ment offer the greatest potential for real 
growth and development of the school, its staff, and its programs for students. 

Although the intent of the original research was to focus on school evaluation, 
senior administrators and trustees directed the move toward program evaluation. 
Using the study as a basis of information, work then proceeded on the application 
of this research to the development of a collaborative model for art and library 
program evaluations. These programs were selected for a number of reasons: 

• a system perceived need to evaluate the effectiveness of these programs; 

• availability of central crfTice leadership; and 

• concerns about the lack of expertise of the generalist teacher in the area of art 
evaliiation and the lack of availaUe research on this tc^ic. 

Acting upon recommendations from the administration, the Board approved the 
development and implementatiai of a new evaluation format Steering committees, 
consisting of generalist and specialist teachers representing elementary and 
secctfidary schools, administration and Alberta Education personnel, were orf nzed 
for each program area. Meetings were held during which time these comjnittees 
were given instruction and direction on the development of quality indicators. Both 
committees proceed^ through the steps outlined in the art program flow chart 
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During the second year of the project, a model was developed and field-tested for 
evaluating the two identified programs. The collaborative model provided the 
structure for ^plication of the effective schools research about evaluation and the 
use of indicators of effectiveness or program quality. Key components in the 
development of the educational quality indicators included the district-based staff, 
and the community and, the resulting determination of comparators, standards, and 
quality outcomes for all programs. 

Following the collection of data through interviews and the administration of 
questionnaires to the various stakeholder groups, analyses was conducted. As a 
result of the findings, a system- and school-based action plan was developed and 
initiated. 

As a result of staffing changes, identified system needs and the availability of time, 
the art program became the focus of the project in the third year. Work continued 
through the various steps outlined: the identification and verification of the student 
outcomes; and, the identification, development, and refinement of evaluation tools 
and processes. System and teacher inputs were re-examined and the instruments 
modified as required. 

Findings 

The findings of the case study indicated that a new model for school and program 
evaluation should be developed. The result of the research was the development of 
a collaborative model which places much greater responsibility and control in the 
hands of the stakeholders - school-based administrators, staff, students, and 
parents. They become major participants and decision makere in school and 
program evaluations, in identifying areas of program and professional growth, and 
in bringing about change. The model rests upon certain basic assumptions 
grounded in the literature on school effectiveness and school improvement The 
school is the primary unit of decision making (Smith and Purkey, 1985). If 
changes are to occur, they require ownership that comes from tlie opportunity to 
participate in defining change, and the flexibility to adapt it to individual 
circumstances. Change does not come from externally imposed procedures 
(Fullan, 1982). 
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Schools need to identify areas requiring improvement and work actively toward this 
end. Empowerment of school-based staff and administration is fundamental to 
reviewing and improving schools. As a perception check, a follow-up 
questionnaire was distributed to the stakeholders at the conclusion of the art 
evaluation. The results from this questionnaire, in conjunction with a review of the 
content and the initiation of the program action plans developed by the schools, 
confirmed that the collaborative model was preferred (Appendix C). 

The collaborative nature of this approach resulted in a "buy in" by stakeholder 
groups. The development and use of quality indicators was positively received and 
their use incorporated into all assessment procedures. 

As predicted by the art steering committee, evaluation procedures were identified as 
an area of concern. A third of the over 3,000 students surveyed did not understand 
how their report card mark was established; only 7% indicating a clear 
understanding of the process. Most parents (80%) were not aware of how their 
child was being evaluated and 37% of the teachers questioned indicated problems 
with evaluation procedures. A follow-up questionnaire addressed to teachers and 
administrators confirmed that through the application of the collaborative model and 
the identification of quality indicators, a positive change in attitude regarding 
assessment in art had taken place. 

The model presented in Figure 2, although originally developed for an art program, 
is basically a generic model that could be applied to other subject areas with few 
modifications. Assessment procedures to measure the desired student outcomes, 
can be identified andJov developed. 

The Art Program Model 

Figure 3 presents the Results-based Art Program Ban, which is a refinement of 
Figure 2. It does not include the inputs of the home, community, and society, 
some of which are inherent under other headings. This model encourages the 
teacher to identify his/her individual mission statement/belief. It stresses the 
importance of inputs into the program; the need to take students from where they 
are with the preassessment and to track their growth along the continuum. The plan 



49 

38 



assists teachers in focusing on the desired student outcomes and, through the use of 
a variety of assessment procedures, determine the actual student outcome. 

Implications 

1 . Based on the current hterature and the practical application, it has been 
demonstrated that a more effective model for school and program evaluation 
involving collaboration and the identification of educational quality indicators 
can be designed and implemented 

2. The development of a clear set of standards or indicators of educational quality 
would be a desirable step in moving the evaluatic«i model on to more objective 
ground, and would allow much more professicwial involvement of school level 
personnel. 

3 . Although the art program evaluation was a practical application of the research, 
the model developed could be applied, with few modifications, to other subject 
areas. However, assessment procedures would have to be identifiedydeveloped 
for the different programs. 

4. Community/stakeholder involvement in the evaluation process has proven to be 
very valuaWe input and should continue to be utilized. 

Recommendations 

1 . School and/or program evaluations should be designed using a collaborative 
model. 

2. School and/or program evaluations should include the development and use of 
educational quality indicators. A vital component is the involvement of 
stakeholders in defining what constitutes quality. 

3 . School and program evaluation should be an on-going process and not simply 
an event which takes place once every five years or so. An evaluation model 
should assure that program and school evaluation becomes a natural and vital 
part of the curriculum and instruction cycle. 
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4. The program evaluation model that has been developed should be applied to 
other program areas in Lethbridge School District No. 51 and in other 
jurisdictions. 

5. Further development and validation of the art program evaluation model should 
continue, particularly with regard to the refinement of the educational quality 
indicators and the verification o( student outcomes through assessment 
procedures. 

6. Teacher training in the use of a variety of assessment procedures that can be 
employed in measuring whether students have achieved the desired outcomes is 
essential. 

FoUow-up 

Lethbridge School District No. 51 is continuing to expand the use of this model to 
other program areas. Revisions/refinements to the collaborative model will be an 
ongoing process. The identification and development erf assessment procedures for 
the measurement of student outcomes will be expanded to other programs. 

Interest has been expressed by the Calgary Public and Catholic EQI Project 
members to work cooperatively with Lethbridge to merge the two projects. This 
possibility will be explored. 

Closing Statement 

As a result of the research project, it has been determined that the former model of 
program and school evaluation was not consistent with the literature on indicators 
of effectiveness, quality and school improvement. New evaluation models should 
move away from the heavy emphasis on a top down" approach to encourage and 
empower school staff and administrators to be actively involved and interacting in 
assessing the effectiveness of their own programs and in planning for their 
improvement. A collaborative model for system/program evaliations in which the 
use of "educational quality indicators" is a key component, is more effective. 
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APPENDIX A 

LETHBRIDGE SCHOOL DISTRICT #51 PROJECT TEAM (ART) 

GARY HECK, Associate Superintendent, Curriculum and Instruction (Acting), 
Lethbridge School District #51 (1990-1992) 

BARBARA WALKER, Fine Arts Coordinator, Lethbridge School District #51 
(1990-1992) 

DR. EARLE WARNICA, Executive Director, Southern Alberta Professional 
Development Consortium (1989-1990) 

SUB-COMMITTEE 
ART PROGRAM EVALUATION TEAM 

ARMAN EARL, Fine Arts Consultant, Lethbridge Regional Office, Alberta 
Education (1990-1992) 

DL\NNE COOK, teacher. Park Meadows Elementary School, Lethbridge (1991) 

JIM CRAIG, teacher, Fleetwood-Bawden Elementary School, Lethbridge (1991) 

KAREN DOEPKER, teacher. Senator Buchanan Elementary School, Lethbridge 
(1991) 

DIANNE DURDA, teacher. Medicine Hat Catholic Board of Education (1991) 

MARILYN GALL, teacher. General Stewart Elementary School, Lethbridge (1991) 

MARLIN HOWG, teacher, Galbraith Elementary School, Lethbridge (1991) 

JANE HUSON, teacher, Hamilton Junior High School, Lethbridge (1991) 

KAREN ICHINO, art teacher, Lethbridge Collegiate Instimte, Lethbridge (1991) 

DON MATISZ, teacher, Gilbert Paterson Junior High School, Lethbridge (1991) 

LISA MCMULLEN, teacher, Lakeview Elementar>' School, Lethbridge (on 
secondment to the University of Lethbridge) (1991) 

ANNETTE NIEUKERK, teacher, Lethbridge Catholic Separate School District #9 
(1991) 

GARRY SHILLIDAY, teacher, Winston Churchill High School, Lethbridge (1991) 
SHAYNE TOLLMAN, teacher, Cardston School District #2 (1991) 
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LETHBRIDGE SCHOOL DISTRICT No. 51 PROJECT TEAM 

(LIBRARY) 



GARY HECK, Acting Associate Superintendent, Lethbridge School District #51 

BETTY BAILEY, Project Leader, teacher-librarian, Wilson Junior High School, 
Lethbridge 

SUB-COMMITTEE 

INTERNAL 

JANICE BROWN, teacher-librarian, Winston Churchill High School, Lethbridge 

MICHELLE DIMNIK, teacher, Galbraith School, Lethbridge 

JOHN LOREE, Assistant Principal, Wilson Junior High School, Lethbridge 

LOLA MAJOR, teacher, Lethbridge Collegiate Institute 

JOHN REGIER, teacher, Gilbert Paterson School, Lethbridge 

CAROL STEEN, Principal, Allan Watson School, Lethbridge 

IRENE YAMAMOTO, teacher-librarian, Hamilton Junior High School, Lethbridge 

KAREN YOUNG, teacher, Nicholas Sheran School, Lethbridge 

EXTERNAL 

BARB HUSTON, Coordinator of Curriculum Laboratory, University of 
Lethbridge 

EUGENE KULMATYKI, Coordinator of Media Services, Red Deer Public School 
District 

DICK MTTTON, Mathematics, Media & Technology, Consultant, Alberta 
Education RegicMial Office 
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APPENDIX B 



FORM A 



LETHBRIDGE SCHOOL DISTRICT #51 
ART PROGRAM EVALUATION 
TEACHER/ADMINISTRATION QUESTIONNAIRE 

Using the scale «... 

Positive 4 3 2 1 Negative Don't Know ? 

1. How do you perceive the importance of the Art Program in your 
school? 
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By administration 4 3 2 1 

By teachers 4 3 2 1 

By students 4 3 2 1 

By parents 4 3 2 1 

2. FACILITIES 

Is there a specialized art room? Yes No 
Rate the facility you are presently using: 

For teaching purposes 4 3 2 1? 

For storage purposes 4 3 2 1? 

Student work space 4 3 2 1? 

For display areas 4 3 2 1? 

3 . BUDGET/EQUIPMENT/SUPPLIES 
Rate the following: 

Budget allocation 4 3 2 1? 

Ordering procedures in school 4 3 2 1? 

Ordering procedures throughout system 4 3 2 1? 

Quality of supplies 4 3 2 1? 

Available equipment 4 3 2 1? 
Availability of authorized and 

recommended resources 4 3 2 1? 

Maintenance of equipment/replacement 4 3 2 1? 

4. (a) ART INSTRUCTION ( self -rating ) 
Rate the following: 

Teacher interest in subject 4 3 2 1? 

Teacher training 4 3 2 1 ? 

Classroom climate 4 3 2 1? 
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Classroom routines 


4 


3 


2 ] 


7 


Adherence to the Program of Studies 


4 


3 


2 ] 


7 


Long-range and unit planning 


4 
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2 ] 
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Varied teaching strategies 


4 
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2 ] 
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Evaluation procedures (teacher) 
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Art's Alive exhibits 
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Bowman exhibits (Jr. /Sr. High) 


4 


3 


2 ] 


7 


Art tours 


4 


3 


2 ] 


7 


Special arts nights 


4 


3 


2 ] 


7 



other: 



ERIC 
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6 . COMMENTS : 



SCHOOL : 



Please return to the school office by January 31, 1991 
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FORM B 



SCHOOL : GRADE : 



LETHBRIDGE SCHOOL DISTRICT #51 
ART PROGR2U4 EVALUATION 
STUDENT QUESTIONNAIRE - Grades 1-3 



Yes No Not sure 




1. 


We do lots of different kinds of art 


Yes 


No 


Not 


sure 


2. 


We have art in a special art room 


Yes 


No 


Not 


sure 


3. 


We have lots of art books in our room 
and in our library 


Yes 


No 


Not 


sure 


4. 


My teacher helps me with my art 


Yes 


No 


Not 


sure 


5. 


We have lots of pictures on the wall 


Yes 


No 


Not 


sure 


6. 


My art pictures have been on the wall 


Yes 


No 


Not 


sure 


7. 


We talk about different kinds of art 


Yes 


No 


Not 


sure 


8. 


My class has visited an art show 


Yes 


No 


Not 


sure 


9, 


I like my art class 


Yes 


No 


Not 


sure 


10. 


I think I am a good artist 


Yes 


No 


Not 


sure 


11. 


My teacher thinks I am a good artist 


Yes 


No 


Not 


sure 


12. 


Everyone works hard in art 


Yes 


No 


Not 


sure 


13. 


I have time to finish my art 


Yes 


No 


Not 


sure 


14. 


I know how to take care of different 
art materials such as paint brushes, 
paints, blue, scissors, pencils, 
crayons, etc. 


Yes 


No 


Not 


sure 



C2 



FORM C 



SCHOOL: GRADE: 4 

LETHBRIDGE SCHOOL DISTRICT #51 
ART PROGRAM EVALUATION 
STUDENT QUESTIONNAIRE - Grades 4-6 



©©©© 



ERIC 



Using the scale, circle the number 
which best tells how you feel about 
each statement with: 4 being "best" 
or "always true"; 3 "usually true"; 
2 "sometimes true"; 1 "never true" 

1. We can do many different kinds of art 
activities with the art supplies in 

our school 4 3 2 1 

2. We have lots of art books in our room 

and in our library 4 3 2 1 

3. Our class goes to a special room for art 4 3 2 1 

4. My teacher helps and advises me with 

my art projects 4 3 2 1 

5. We have lots of student art displayed 
in our room and on other wall in the 

school 4 3 2 1 

6. My art work is displayed sometimes 4 3 2 1 

7. We talk about artists and their work 4 3 2 1 

8. There are pictures by famous artists 

on display 4 3 2 1 

9. My class has visited an art show 4 3 2 1 

10. Everyone works hard in art class 

and hardly ever fools around 4321 

11. I am learning a lot about drawing, 
painting, sculpture, print making 

and other things in my art class 4 3 2 1 

12. I like my art class 4 3 2 1 

13. My teacher thinks I am a good artist 4 3 2 1 

14. I think I am a good artist 4 3 2 1 

15. My teacher has taught me how to 
take care of various art supplie^^ 

O ^ e.g., paint brushes, paint, etcbo 4 3 2 1 
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FORM D 



LETHBRID6E SCHOOL DISTRICT #51 
ART PROGRAM EVALUATIOI^ 
STUDENT QUESTIONNAIRE - GRADES 7-12 



Please check appropriate box: 



Junior High student 
Senior High student 



Please circle the nximber which best 
expresses your feeling about each 
statement: 4 indicates "always 
true"; 3 "usually true"; 
2 "sometimes true"; 1 "never true" 



I have enough personal work and 
storage space for my projects 



2. 



4. 

5, 

6. 
7. 

8. 
9. 

10. 

11, 



ERIC 



We have a variety of materials 
and supplies so that we can 
do different kinds of art 

We have a wide variety of art 
reference books 

I get advice and help with my work 
from the teacher and other students 

Student art work is displayed in 
various areas of the school 

My work is displayed sometimes 

We have special activities in our 
school about art, field trips, art 
shows, arts nights 

I enjoy art 

I take pride in my work, my 
growth as an artist and the 
accomplishments of others 

I am developing creative thinking 
skills by solving the problems I 
encounter while doing my art work 

I am learning how to communicate 
through my art and other pecple ' s 
art - ideas, thoughts, emotions, 
stories, etc. 



High > Low 



4 3 2 1 
4 3 2 1 



4 
4 

4 



3 
3 



2 
2 



1 
1 
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12. I am developing an appreciation 
for the arts by learning about 
different artists, different art 
styles and periods, and am 
developing critiquing skills 

13. I am learning to value art by 
working at it, taking care of my 
my work and materials 



14. I am learning the vocabulary of 
art (design elements, design 
principles) and developing 

critiquing skills 4 3 2 1 

15. I am developing skills/techniques 
in a variety of studio areas - 
drawing, painting, two-dimensional 

design, three-dimensional design, etc. 4 3 2 1 



16. Others think I am progressing and 
developing my ideas, skills and 

techniques 4 3 2 1 

Question 17 to be answered only by senior high school students. 

17. I am beginning to establish a 
personal " style and am taking 
control of my artistic 

development 4 3 2 1 



COMMENTS : 



Are you planning to attend college or 

university? Yes Q No j j 

Are you planning an art-related career, 
e.g. , architect, illustrator, fine 
artist, interior decorating, fashion 

designer, art teacher, window dresser, etc. Yes [~[ No | [ 



SCHOOL : 



65 
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FORM E 



LETHBRIDGE SCHOOL DISTRICT #51 
ART PROGRAM EVALUATION 
PARENT QUESTIONNAIRE 



My children are in grades(s): (please circle) 

123456789 10 



11 



12 



Please Circle 



!• Are you aware that the art program focus 
has changed from product to process? 

2. Are you aware that art is a required 
subject at the elementary level? 

3. Are you aware that there are specific 
concepts and skills that are required 
by the provincial curriculum to be 
taught at each grade level? 

4. Are you aware of how your child is 
evaluated in art? 

5. Do you feel that art is considered an 
important subject in your child's 
school? 

6. Do you find art attractively displayed 
in your child's school? 

7. Has your child experienced working with 
a variety of art materials? 

8. Have vou or your child attended any 
special art activities, e.g., field 
trips, art exhibits, resource people, 
etc. 

9. Does your child enjoy art? 

10. Do you feel that your child is 
developing understanding and 
skills in art? 

11. Does your child value art? 

12. Does your child bring his/her 
art work home? 



Yes 



Yes 



Yes 



Yes 



Yes 



Yes 



Yes 



Yes 
Yes 

Yes 
Yes 

Yes 



No 



No 



No 



No 



No 



No 



No 



No 
No 

No 
No 

No 



b J 
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13. Is your child developing respect 
and appreciation for the art work 

of others? Yes No 

COMMENTS : 



Questions 14 and 15 to be answered only by parents of secondary 
students 

14. Does your child strive for excellence 

in art jprojects? Yes No 

15. Would you approve of your pursuing 
an art-related career^ e*g*/ 
architect, illustrator, fine artist, 
interior decorator, art teacher, 

window dresser, etc.? Yes No 

High > Low 

16. Overall rating of your child's 

school art program 4 3 2 1 

SCHOOL: 



Please return to your child's teacher by January 31, 1991. 
ErJc 56 



FOLLOW-UP QUESTIONNAIRE 
TO THE 

COLLABORATIVE ART PROGRAM EVALUATION 
1 . What are the strengths of this evaluation procedure? 



2. What are the weaknesses of this procedure? 



3. Suggestions/Recommendations as a result of your experience 
with this new procedure • 



4. Please conunent on your personal involvement in the evaluation. 



( Thank you for your co-operation both with the evaluation and for 
taking the time to complete and return this follow-up 
questionnaire. Please return this form to Central Office at your 
earliest convenience. ) 
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APPENDIX C 



»1 



1990-91 Art Evaluation 



Lcthbridge School District #51 



Teacher/ Administration Questioonairc 


4 


3 


2 


1 


Don't 
Know 


1. 


How do you perceive the importance of the Art 
program in your school? (a) By administration 


42 


45% 


34 


36% 


9 


10% 


2 


2% 


7 


7% 




(b) By teachers 


36 


38% 


49 


52% 


8 


9% 


1 


1% 








(c) By students 


37 


40% 


46 


49% 


9 


10% 






1 


1% 




(d) By parents 


16 


17% 


35 


38% 


26 


28% 


1 


1% 


15 1 


16% 


2. 


FACILITIES Rate the fadliiy you are presently 
using: (a) For leaching purposes 


31 


34% 


41 


45% 


15 


16% 


4 


4% 


1 


1% 




(b) For storage purposes 


17 


18% 


40 


43% 


27 


29% 


6 


7% 


2 


2% 




(c) Student work space 


25 


27% 


33 


36% 


19 


21% 


13 


14% 


1 


1% 




(d) For display areas 


19 


21% 


39 


42% 


24 


26% 


10 


11% 






3. 


BU&GSTyeOUlPMEhJT/SUPPUES Rate the 
following: (a) Budget aliocadon 


16 


18% 


45 


49% 


12 


13% 


2 


2% 


16 


18% 




(b) Ordering procedures in school 


26 


29% 


51 


56% 


7 


8% 


1 


1% 


6 


7% 




(c) Ordering procedures throu^out system 


6 


7% 


34 


38% 


11 


12% 


2 


2% 


37 


41% 




(d) Quality of supplies 


19 


21% 


52 


57% 


7 


8% 


5 


5% 


8 


9% 




(e) Available equipment 


16 


18% 


50 


56% 


15 


17% 


3 


3% 


5 


6% 




(f) Availability of recommended resources 


19 


21% 


45 


tO<k 


19 


21% 


2 


2% 


5 


6% 




(g) Maintenance of equipment/replacement 


16 


18% 


49 


55% 


14 


16% 


3 


3% 


7 


8% 


4. 


aAT instruction (self-rating) Rate tiie 
following: (a) Teacher mterest m subject 


39 




37 


43% 


8 


9% 


1 


1% 


2 


2% 




(b) Teacher training 


17 




28 


32% 


33 


38% 


6 


7% 


3 


3% 




(c) Classroom climate 


29 




50 


58% 


5 


6% 


0 




2 


2% 




(d) Classroom routines 


26 




54 


63% 


4 


5% 


0 




2 


2% 




(e) Adherence to the Program of Studies 


25 




44 


50% 


10 


11% 


1 


1% 


8 


9% 




(f) Long*range & unit planning 


25 


tiij 


40 


45% 


15 


17% 


2 


2% 


6 


7% 




(g) Varied teaching strategies 


25 




44 


51% 


14 


16% 


0 




4 


5% 




(h) Evaluation procedures (teacher) 


13 




49 


ifi% 


18 


21% 


0 




7 


8% 




(i) Evaluation procedures (student) 


3 




47 


54% 


25 


29% 


4 


5% 


8 


9% 




(j) Practices safety procedures 


38 




39 


4l% 


2 


2% 


2 


2% 


6 


7% 




(k) Articulation/peer coaching 


16 


ILJ 


48 


56% 


11 


13% 


3 


4% 


7 


8% 


4. 


ART INSTRUCTION (total program) Rate the 
following (a) Teacher mterest m sooject 


25 




45 


52% 


13 


15% 


0 




3 


3% 




(b) Teacher training 


19 




2^ 


28% 


32 


36% 


4 


5% 


8 


9% 




(c) Classroom climate 


17 




60j 


6i% 


6 


H 


0 




5 


6% 




(d) Classroom routines 


22 




i 


6% 


0 




5 


6% 




(e) Adherence to the Program of Studies 


20 




4f 


54% 


10 


11% 


0 




10 


11% 




(f) Long-range & unit planning 


23 




37 


43% 


10 


11% 


1 


1% 


16 


18% 




(g) Vaned teaching strateaes 


18 


EC 


r 46 




9 


10% 


0 




13 


15% 




(h) Evaluation prooedures (teacher) 


9 




1 46 




17 


20% 


1 


1% 


14 


16% 




(i) Evaluatioa procedures (student) 


6 


tiJ 


52 


66% 


12 


14% 


1 


1% 


16 


18% 




(j) Practices sauety procedures 


29 


33% 


41 


47% 


4 




1 1 


1% 


12 


14% 




(k) ArticulatioB/peer f"tH*"W 


15 


iH 


52 


58^ 


9 


Hi'.l 


1 1 


1% 


13 


14% 


5. 


aCTIVTHK SUmHTEDBV TEaCHER/ 
SCHOOL Rate the folkmaf: 
(a) Art displayed in school 


91 


55% 


27 


29% 


1A 
IV 


11% 


A 




■t 






(b) Educatioa week activities 


48 


^% 


29 




1 


8% 


0 






8% 




(c) Orientatioo activities 


24 








14 


■lifci 


0 




25 


27% 




(d) Art's Alive exhibit 


2^ 


^ 








IM 






14 


15% 




(e) Central office exhibits 


21 


24% 


2i 


Zj% 


18 


21% 


5 


6% 


21 


24% 




(f) Bowman exhibits (jr/sr high) 


12 


ii% 


11 


iH 


11 


14% 


i 


6% 


42 


52% 




(g) Art tours 


1 


8% 


IS 


21^ 


If 


20« 


12 


14% 


32 


37% 




(h) Special arts oi;;^ 


11 


13« 


u 


14« 


4 


M 


16 


18% 


44 


51% 




UKE 




\ 181( 


46% 


584 


15% 


122 


3% 


469 


11% 



2. FAaUTIES Is there a specialized art room? 

SESTCOPVMAILABIE — 



Yes No 
74 71% 21 22% 
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*2 



1990-91 Alt Evaluation 



Uthbridge School District #51 



Parent Questtoaaalre (Grades 1 • 6) 


Yes 


No 


L Are you aware that the art program focus has changed from 
product to process? 


156 


17% 


758 


82% 


2, Are you aware that art is a required subject at the 
elementary level? 


764 


S3% 


154 


16% 


L y aware tnat tiicrc are speciuc concepts and 
that are required by the provincial curriculum to be 
taught at each grade level? 


513 


56% 


405 


44% 


4. Are you aware of how your child h evaluated in art? 


174 


19% 


740 l80% 


S. Do you feel that art is considered an important subjert in 
your child^s school? 


765 


87% 


114 


12% 


0. Uo you trna art attractively displayed m your child s 
school? 


871 


96% 


27 


03% 


7. Has your child experienced working with a variety of art 
materials? 


783 


89% 


91 


10% 


8. Have you or your child attended any special art activities, 
e.g.» field trifKS, ait exhibits, resource people, etc? 


463 


51% 


433 


48% 


9. Does your child enjoy art? 


858 


95% 


38 


04% 


10. Do you feel that your child is developing understanding 
and skills in art? 


780 


90% 


80 


09% 


11. Does your child value art? 


787 


90% 


87 


09% 


12. Does your child bring his/her art work home? 


808 


91% 


79 


08% 


13. Is your child developing respect and appreciation for the 
art work of others? 


7a 


91% 


69 


08% 


14. Does your child strive for excellence in art projects? 


180 


86% 


27 


13% 


15. Would you approve of your child Dursuing an art*reUted 
career, e.g^ architect, illustrator, file artist, interior 
decorator, art teacher, window dresser, etc? 


183 


88% 


24 


11% 




1833 


73% 


3126 


26% 



16. 



Overall radog of yoar diiid's sdiool ait program 



High > Low 

4 3 2 1 

151 21% 481 66% 89 13% 7 0% 



/ 0 



ERIC 
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1990-91 Art Evaluation 



Lethbridge School District #S1 



Student Questioiiittirt (Grades 1 - 3) 


Yes 


No 


Not 
Sure 


1. We do lots of differenf kind< nf art 


726 


89% 


17 


02% 


68 


08% 


2. We h^ve art in a SDCcia] art rnnm 


376 


46% 


349 


43% 


82 


10% 


3. We have lots of art books in our room and in nur Hhrarv 


423 


53% 


90 


11% 


283 


35% 


4. My teacher helps me with txxy art 


655 


83% 


74 


09% 


55 


07% 


5. We have lots of pictures on the wall 


685 


86% 


52 


06% 


52 


06% 


6» My art pictures have been on the wall 


692 


88% 


43 


05% 


49 


06% 


7, We talk about different kinds of art 


605 


77% 


61 


07% 


117 


14% 


8 Mv rlacg hag visited an art 


177 


22% 


532 


68% 


71 


09% 


9. I like mv art <*lacc 


686 


88% 


42 


05% 






10. I think I am a good artist 


567 


73% 


84 


10% 


112 




11. My teacher thinks I am a good artist 


534 


68% 


32 


04% 


209 


26% 


12. Everyone works hard in art 


600 


77% 


48 


06% 


124 


16% 


13. I have time to finish my art 


573 


75% 


91 


11% 


95 


12% 


14. I know how to take care of different art materials such as 
paint bnishes, paints, ^ue, scissors, pencils, crayons, etc 


671 


89% 


26 


03% 


54 


07% 


15. I think I am a good artist 


593 


80% 


110 


14% 


36 


04% 




8814 


70% 


1905 


15% 


1718 


13% 



7x 
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1990-nAitEvaIiiatkM 



Lethbridge School Dlstrkt #51 



Stadeat QqcstionMirc (Grade 4-6) 


4 


3 


2 


1 


1. We can do many different kinds of art activities with the art 
supplies in our school 


455 


52% 


324 


37% 


80 |l)9% 


u !oi% 


2. We have lots of art books in our room and in our library 


203 


23% 


290 


33% 


261 t30% 


100 


11% 


3. Our class goes to a special room for art 


328 


38% 


226 


26% 


191 122% 


100 


11% 


4. My teacher helps and advises me with my art projects 


490 


57% 


253 


29% 


91 


10% 


20 


02% 


5. We have lots of student art displayed m our room and on 
other walls in the school 


479 




240 


28% 


114 


13% 


19 


02% 


6. My art work is displayed sometimes 


364 


42% 


243 


28% 


161 


18% 


82 109% 


7. We talk about artists and their work 


183 


22% 


212 


25% 


256 


30% 


178 !21% 


8. There are pictures by famous artists on display 


100 


11% 


125 


14% 


185 


22% 


> 

429 'pi% 


9. My class has visited an art show 


69 


08% 


79 


09% 


104 


12% 


559 ^ 


10. Everyone works hard in art class and hardly ever fools around 


131 


15% 


247 


29% 


327 


38% 


139 


16% 


11. I am learning a lot about drawing, painting, sculpture, print 
making and otlicr thing;^ in my art class 


458 


54% 


236 


28% 


116 


13% 


30 


03% 


12. I like my art class 


487 


(4% 


163 


21% 


81 


10% 


26 


03% 


13. My teadier thinks I am a good artist 


282 


34% 


304 


36% 


179 


21% 


61 


07% 


14. I think I am a good artist 


341 


41% 


228 


27% 


165 


19% 


94 


11% 


15. My teacher has taught me bow to take care of various art 
supplies, e.g., paint orushes, paint, et& 


507 


62% 


189 


23% 


83 


10% 


37 


04% 




4*77 


38% 


3359 


26% 


2394 


19% 


1887 


15% 
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BEST GOPy AVAILABLE 



#6 



1990-91 Alt Evalaatton 



Lethbridy School DUtrlct #51 





4 


3 


2 


1 


L I have enough pcrsooal work and storage space for my 
projecu 


102 


26% 


194 


51% 


71 


18% 


11 


02% 


1 We have a variety of materials and supplies so that 
we can do different kinds of art 


207 


54% 


145 


3S% 


22 


05% 


3 


00% 


3. We have a wide variety of art reference books 


S4 


22% 


164 


44% 


98 


26% 


24 


06% 


4. I get advice and help with my work from the teacher 
and other students 


222 


ss% 


lis 


31% 


31 


08% 


7 


01% 


5. Student art work is displayed in various areas of the school 


249 


66% 


92 


24% 


22 


05% 


10 


02% 


6. My work is displayed sometimes 


6t 


1S% 


129 


35% 


89 


24% 


75 


20% 


7. We have special activities in our school about art, 
field trips, art shows, arts nigbu 


75 


20% 


112 


30% 


99 


27% 


79 


21% 


8. I enjoy ait 


227 


61% 


111 


30% 


24 


06% 


7 


01% 


9. I take pride in my work, my growth as an artist and 
the accomplishments of others 


173 


46% 


157 


41% 


38 


10% 


7 


01% 


10. I am developing creative thinking skills by solving 
the problems lencounter ^i4iile doing my art work 


117 


31% 


196 


52% 


51 


13% 


8 


02% 


IL I am irn"^«»ff how to communicate through ny tft and 
other peo^s art - ideas* thoughts* emotions* stories* etc 


74 


19% 


197 


53% 


79 


21% 


21 


05% 


12. I am developing an appreciation for the arts by learning 
about different artists^^ different art styles and periods 
and am developing critiquing skills 


105 


2S% 


1S5 


49% 


72 


19% 


9 


02% 


13, I am learning to value ait by working at it, taking 
care of my work and materials 


110 


48% 


150 


40% 


38 


10% 


2 


00% 


14. I am learning the vocabulaiy of art (design elements* 
design prinaples) and developing critiqumg skiQs 


143 


3f% 


153 


41% 


64 


17% 


7 


01% 


15. I am developing skiUs/tedhniquea tn a variety of stitdio 
three-dimensional design* etc 


1<9 


45% 


149 


40% 


41 


11% 


11 


02% 


16. Others think I am progressing and developing my ideas* 
skills and tecfaniquea 


97 


JT% 


170 


41% 


(1 


17% 


22 


06% 


17. (Sr. Hi( Only) I am hefjnninr to esubltsh a personal 
^styie' jjd am taking control oi my artistic developaseat 


52 


29% 


tt 


50% 


29 


16% 


5 


02% 







Are you plaaniag to attend coOcfB or uaivcnky? 
Are you pUaning an art-related cveer? 



Yea No 
254 86% 39 13% 



Yea No 
119 45% 142 54% 
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1990>91 Art Eveloation 



Liitibildge School District #51 



Ptftst QocstlMBaire (Grades 7 • 12) 


Yes 


No 


L Are vou aware that the art procram focus has chanstd from 
product to proceu? 


Ark. 

4Q 


15% 


21s 


S4% 


1 Are you aware that art is a required subject at the 

W>w*ii will all J Mkt vl • 








19% 


3. Are you aware that there are.speciiic coacepu and skills 

that Are reouircd hv the nrnMn^iiil nirn/»iiliifn ir\ 

taught at each grade level? 


164 


64% 


89 


35% 


4 Arc vmi awsre nf hmv untir rhil/l tc 


/J 




VJy 


'VIOL 

71% 


5. Do you feel that art is considered an important subiect in 








13% 


6. Do you find art attractively displayed in your child's 

KuOOif 


237 




6 


02% 


r«49 jvur uiuu cxy^rivocpu woruug wilq s wiCij oc arc 

materials? 


216 


8S% 


28 


11% 


V* JVUA UUiU AlLCnuCU AQj special mXX SvUVlUCSy 

e.g«, field trips, art exhibits, resource people, etc? 


111 






ACPL 


9. Does your child enjoy art? 


240 


97% 


7 


02% 


10. Do you feel that your child is developing v*H<f*TtirMliffg 
and skills in art? 






/ 


\X£l9 


IL Does your diOd value art? 


223 


19% 


2S 


10% 


12. Does your child brbag his/her art work home? 


22i 


93% 


16 




13. Is your child developing respect and appredntioo for the 


197 


19% 


24 


10% 


14. Does your child strive for exoeUeoce in art projects? 


19 


90% 


9 


09% 


15. Would you approve of your diild pursuing an art-related 
career, architect, illustrator, fine artist tnCerior 
decorator, art teacher, window dresser, etc? 


St 


t7% 


12 


12% 




2567 


7J% 


(27 


25% 



16. Overall radaf of your child's school ait program 



Hijii > Low 

4 3 2 1 

4t 24% 121 61% 26 13% 1 00% 



EST COPY AVMAILE 

7^. 



ERiC 



63 



SAMPLE OF RESPONSES TO THE FOLLOWUP ART PROGRAM EVALUATION 

QUESTIONNAIRE 



(46 responses to 150 questionnaires distributed.) 

1. Strengths: Involvement of staff; involvement of stakeholders; 
the opportunity to provide input; very calm, non~ threatening 
process; positives are emphasized; outcomes clearly identified 
with assessment procedures to verify; builds staff morale and 
cooperation to improve together in team planning and team 
teaching; development of the indicators; system wide instead of 
individual schools -everyone benefited from the process; short 
period of time required for the evaluation process; many teachers 
felt more comfortable with collegues than if only an external 
team was involved; the team approach gave a wide enough 
perspective; use of practising teachers helps to keep the 
evaluation at a realistic level; the team approach gave the 
evaluators a chance to discuss perceptions of the art program; 
the Thurday morning team meeting with eveiryone was an excellent 
idea; we became more knowledgeable about other schools; good 
balance between expert/trained teachers in art and some without a 
broad background; pointed out quite clearly the strengths and 
weaknesses of the programs in the city; impressed with the 
results/findings; the variety and diversity of the art work done 
and the programs which have been developed; involvement of a 
variety of people-teachers, consultants^ primary/secondary, 
generalists etc. 

2. Weaknesses: Teachers still feel insecure about their program; 
checking of the validity/reliability of the survey forms used; 
first time evaluators and teachers that were hearing about 
outcome based education, quality indicators etc. for the first 
time would benefit from even more extensive training; perhaps 
elementary and secondary teachers should have worked separately; 
I found the time frame a little short ; different teams may 
interpret situations differently; and many returns indicated no 
weakness indicated. 

3. Suggestions/Recommendations: All principals need to play an 
active role; one external team takes longer but perhaps there is 
more reliability and consistency?-they do it more often; would 
like to see the use of more external evaluators who are 
specialists ( secondairy level); more time for talking; if teachers 
could be freed up in small groups, they would benefit more and 
could feed off each other for ideas; more time together-the 
evaluation team (external) should have time to meet for a longer 
period of time with the teachers in the schools; again, a large 
number of forms were returned with no response to this question. 
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4. I found this experience to be invaluable. 

I received a tremendous inservice and appreciation for our art 
programs . 

I liked the process • A much better procedure • 
A terrific learning experience • 

Provided an excellent inservice for teachers/administrators. 

The evaluation was a personal learning experience in the area of 

teaching art. 

Very exciting and encouraging. Maybe we are finally going to get 
this evaluation stuff right. 

Excellent learning and motivating experience. 

A valuable learning experience . Now we need even more training 
and the opportunity to followup on the recommendations. 
Wonderful experience but I still need to work on indicators and 
how to measure them. Very worthwhile. 

(There were many additional comments similar to the above.) 



ERLC 



65 



APPENDIX D 



ELEMENTARY STUDENT SURVEY RESULTS 



ERIC 













Yes 


No 


Not 
Sure 


1. 


I go to my school library as often 
as I like. 


470 
37% 


544 
43% 


238 
19% 


2. 


I usually go to the library: 

a) once a day 

b) every few days 

c) once a week 

d) less than once a week 




123 
9% 
404 
31% 
633 
49% 
107 
8% 






3. 


I usually go to 
a book. 


the 


library to 


find 


1078 
85% 


186 
14% 


1 
0% 


4. 


I usually go to 
(look around). 


the 


library to 


browse 


539 
42% 


715 
56% 


10 
0% 


5. 


I usually go to 


the 


library to 


read. 


716 

CT C 


539 
42% 


9 
0% 


6. 


I usually go to 
exchange books. 


the 


library to 




867 
68% 


389 
30% 


5 
0% 


7. 


I usually go to 
with others. 


the 


library to 


visit 


319 
25% 


936 
74% 


7 
0% 


8. 


I usually go to 
at centres. 


the 


library to 


work 


354 
28% 


902 
71% 


6 
0% 


9. 


I usually go to 
research. 


the 


library to 


do 


560 
44% 


693 
54% 


9 
0% 


10 • 


I usually go to 
on the computer 


the 


library to 


work 


530 


718 
57% 


10 
0% 


11. 


I usually go to 
magazines. 


the 


library to 


read 


341 

Z /* 


901 

r-J O Q- 


a 

0% 


12- 


I can always find an adult in the 
library to help me. 


865 
72% 


171 
14% 


152 
12% 


13. 


In my libr^ary there 
for free reading. 


are lots of books 


610 
84% 


50 
6% 


66 
9% 


14. 


I can find many books 


► to read. 




1045 
87% 


82 
6% 


74 
6% 


15. 


I enjoy reading 


Library books. 


77 


1072 
88% 


79 
6% 


59 
4% 
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Yes 


No 


Not 
Sure 


16. 


My library has lots of books for 
getting information to write reports. 


934 
76% 


86 
7% 


193 
15% 


17. 


My library has lots of information 
to help me find answers to questions. 


910 
75% 


88 
7% 


210 
17% 


18. 


My library has lots of other material 
(besides books) for getting informa- 
tion. 


877 
72% 


117 
9% 


213 
17% 


19. 


The teacher-librarian teaches me 
how to use the library. 


872 
72% 


185 
15% 


153 
12% 


20. • 


My classroom teacher teaches me 
how to use the library. 


633 
52% 


353 

^ Z7 ^ 


212 

1 7* 


21. 


I can .locate library material by 
myself. 


780 
63% 


225 
18% 


215 
17% 


22. 


I am able to take out the things 
I need from the library. 


796 
64% 


168 
13% 


263 
21% 
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ELEMENTARY SUMMARY - PARENT QUESTIONNAIRE 



1. My child's school library is open 
when he/she needs to use it. 

2. My child's school library contains a 
wide variety of resources, i.e., 
books , tapes , f ilmstrips , magazines , 
files, etc. which meet his/her needs and 
interests as a learner. 

3. There is always an adult available 
to help my child. 

4. The school library has enough 
resources available so that my child 
is able to complete assignments. 

5. My child is able to find materials 
on his/her own in the library* 

6. The resources in the school library 
are up-to-date. 

7. My child feels comfortable going to 
and using the school library. 

8. My child is able to borrow what 
he/she needs from the school library. 

9* My child uses the school library 
more than the public or other 
library. 

10. My child is encouraged to use resources 
beyond those provided by the school 
library ♦ 

11. The school library is/was an integral 
part of my child's education in 

- elementary 

12. The school library should be an integral 
part of my child's education in 

- elementary 



Yes 


No 


Not 






Sure 


411 


89 


98 


69% 


15% 


16% 


398 


23 


127 


73% 


4% 


23% 


368 


46 


131 


68% 


8% 


24% 


299 


66 


160 


57% 


13% 


oU% 


379 


A O 


IZl 


69% 


9% 


22% 


236 


30 


280 


43% 


D% 


Dl% 


490 


18 


38 


90% 


3% 


7% 


420 


53 


72 


77% 


10% 


13% 


395 


125 


30 




Zoii 




388 


45 


113 


71% 


8% 


21% 


440 


20 


74 


82% 


4% 


14% 


502 


7 


30 


93% 


1% 


5% 
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SECONDARY STUDENT SURVEY RES-ULTS 









Yes 


No 


Not 
Sure 


1. 


My library is open when I need it. 


596 
71% 


109 
12% 


134 
15% 


2. 


I 
a 


spend time in the library because 
teacher takes my class. 


540 
66% 


242 
29% 


28 
3% 


3. 


I spend time in the library by my 
own choice. 


456 
59% 


295 
38% 


21 
2% 


4. 


I 
I 


spend time in the library because 
am "kicked out" of class. 


78 
10% 


663 
87% 


19 
2% 


5. 


I spend time in the library outside 
class time. 


247 
32% 


492 
64% 


23 
3% 


6. 


I 


usually go to the library to: 
a ) study 


453 
60% 


284 
37% 


16 
2% 


7. 




b ) browse 


311 
42% 


410 
55% 


16 
2% 


8. 




c) read 


344 
46% 


383 
51% 


11 
1% 


9. 




d) visit others 


374 
50% 


341 
46% 


19 
2% 


10. 




e) do research 


494 
65% 


248 
33% 


8 
1% 


11. 




f ) do homework 


395 
53% 


331 
45% 


8 
1% 


12. 




g) exchange books 


341 
46% 


382 
51% 


15 
2% 


13. 




h) read magazines 


351 
46% 


370 
49% 


27 
3% 


14. 


Library personnel are always 
available to help me if I need help. 


499 
62% 


177 
22% 


117 
14% 


15. 


The librarian teaches me how to 
use the library. 


466 
61% 


180 
23% 


106 
14% 


16. 


The librarian teaches me how to 
find books, filmstrips, etc. 


464 
64% 


175 
24% 


86 
11% 
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Yes 


No 1 


Not 
Sure 


17. 


My library has a wide variety of 
resources which I can read for: 
a) enjoyment 


482 
67% 


159 
22% 


74 

10% 


18. 


b) interest 


472 
65% 


184 
25% 


69 
9% 


19. 


c) information 


541 
73% 


134 
18% 


60 
8% 


20. 


My library has adequate resources to 
assist me with research and homework: 
a ) books 


592 
78% 


102 
13% 


64 
8% 


21. 


b) filmstrips, videos 


453 
61% 


169 
23% 


110 
15% 


22. 


c) files 


459 
62% 


158 
21% 


116 
15% 


23. 


d) magazines 


498 
67% 


141 
19% 


100 
13% 


24. 


My library has resources which are 
up-to-date. 


371 
47% 


171 
21% 


246 
31% 


25. 


My classroom teacher helps me when 
my class is working in the library. 


577 
71% 


115 
14% 


116 
14% 


26. 


My school library is a good place 
for work and study. 


589 
73% 


85 
10% 


122 
15% 


27. 


I know how to find materials in my 
school library. 


640 
80% 


77 
9% 


80 
10% 


28. 


I can find a place to work when I go 
to our school library. 


659 
82% 


75 
9% 


65 
8% 


29. 


I am able to take out the things I 
need from the library. 


538 
67% 


141 
17% 


118 
14% 


30. 


My teacher encourages me to use our 
school library. 


463 
58% 


220 
27% 


113 
14% 


31. 


I am encouraged to use resources 
beyond those provided by our school 
library. 


455 
56% 


191 
23% 


158 
19% 


32. 


I use the public or other library 
more than my school one. 


413 
52% 


288 
36% 


91 
11% 
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ET L 


ET 


JHTL 


JHT 


SHTL 


SHT 




Who taught you how to: 
















a ) 




489 


133 

J. w O 


o o 






/ 






catalogue? 


64% 
\j T± ^ 




IIS: 






u-^ 


34. 


D ; 




478 


114 


103 


38 


17 


11 






shelf? 


62% 


14% 


13% 


4% 


2% 


1% 


35. 


c ) 


r xnu rexevan u dooks 


















wn^.cn proviae iniror— 


















mat ion fori homework 


^ u / 


JL X O 


1 QQ 

X y y 


XZO 


O Q 
ZO 


1 b 






research and writing 


O O 






X D-^ 










reports? 














36. 


d) 


take notes from 


149 


138 


153 


224 


19 


44 






books or films, etc? 






^ X 








37. 


e) 


organize eg . outline. 


















webbing , etc . and 


1 OA 




XX / 


zy 4 


10 


53 






write a report from 


16% 


19% 


15% 


39% 


1% 


7% 






notes? 














38. 


f ) 


write a bibliography? 


139 


154 


107 


276 


18 


47 








18% 


20% 


14% 


37% 


2% 


6% 


39. 


g) 


present/share a 


112 


189 


103 


283 


15 


50 






report? 


14% 


25% 


13% 


37% 


1% 


6% 



ET - Elementary Teacher l ~ Librarian 

JHT - Junior High School Teacher SHST - Senior High School 31 

Teacher 
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SECONDARY SUMMARY PARENT QUESTIONNAIRE -. 







Yesl 

i 


No 


Not 
Sure 


1. 


My child's school library is open 
when he/she needs to use it. 


107 
69% 


19 
12% 


30 
19% 


2. 


My child's school library contains a 
wide variety of resources, i.e., 
books, tapes, filmstrips, magazines, 
files, etc. which meet his/her needs and 
interests as a learner. 


70 
55% 


12 
10% 


44 

35% 


3. 


There is always an adult available 
to help my child. 


107 
69% 


16 
10% 


32 
21% 


4. 


The school library has enough 
resources available so that my child 
is able to complete assignments. 


QO 
52% 


27 
17% 


48 

31% 


5. 


My child is able to find materials 
on his/her own in the library. 


113 
73% 


15 
10% 


27 
17% 


6. 


The resources in the school libra^^y 
are up-to-date. 


56 
36% 


23 
15% 


76 
49% 


7. 


My child feels comfortable going to 
and using the school library. 


113 
73% 


19 
12% 


23 
15% 


8* 


My child is able to borrow what 
he/she needs from the school librairy. 


109 
70% 


21 
14% 


25 
16% 


9. 


My child uses the school library 
more than the public or other 
X J. orary . 


81 


61 
39* 


13 
8% 


10. 


My child is encouraged to use resources 
beyond those provided by the school 
library. 


111 
68% 


16 
10% 


36 
22% 




The school library is/was an integral 
part of my child's education in 
- junior high 


114 
74% 


19 
12% 


22 
14% 


12. 


The school library should be an integral 
part of my child's education in 
- junior high 


137 
89% 


6 
4% 


11 
7% 
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13, Have you every volunteered to assist in 
the library? 

14 ♦ Do you feel there is adequate teacher 

direction and supervision when students 
are in the library? 



Yes 


No 


Not 




Yes 


No 


Not 






Sure 








Sure 


22 


124 


8 




4 


32 


2 


14% 


81% 


5% 




11% 


84% 


5% 


80 


17 


55 




25 


3 


11 


53% 


11% 


36% 




64% 


8% 


28% 



High 



Low 



15, 



Overall rating of the school library program 



4 3 
27 85 
20% 62% 



2 

23 
17% 



1 
2 

1% 



.S4 
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IMPRESSIONISTIC SCORING 



A 5 Appreciates the work of others and self. Accepts 

T direction. 

T 4 Usually appreciates the work of self and others. Often 

I accepts direction. 

T 3 Sometimes shows an appreciation for work. 

U Seldom accepts direction. 

D 2 Exhibits a negative attitude towards Art. 

E Often reluctant to accept direction or instruction. 

S 5 Locates materials quickly and settles to work without 

E direction. 

T 4 Locates materials but occasionally needs direction to 
settle to work. 

U 3 needs assistance to locate material and needs 

P supervision to get started. 

2 Reluctant to locate material and needs several reminders 
to get started. 

5 Self-disciplined, involves oneself quickly and 

0 effectively. Stays on task. 

N 4 Generally works well , sometimes needs a reminder to 

start, often on task. 

T 3 Needs assistance during lesson to stay on task. Easily 

A distracted. 

S 2 Needs constant reminders to get started and stay on 

K task. 



C 
0 
M 
P 
L 
E 
T 
I 
0 
N 



5 Work is completed on time and effort has been put into 
project. 

4 Work is completed on time but more care needed. 
3 Work is seldom completed on time and work is often of 
poor quality. 

2 Assignments are frequently incomplete and work is 
sloppy. 



5 Involves oneself quickly, does a thorough job and helps 

others when finished. 
4 Gets to work quickly, may forget one thing to clean up. 
3 Needs a reminder to get started, often leaves something 

for someone else to clean up. 
2 Often involved in problem situations during clean up, 

needs constant supervision . 
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SUGGESTED CRITERIA FOR MARKING A CONTOUR SKETCH 
(single short lesson) 



-drawing is a reasonable size 1 
-90/10 contour lines evident 3 

(90% looking at objects - 10% looking at object) 
-neatness and craftsmanship _1 

5 



Marking a drawing (realistic e.g., animals) 2 

(final project following a series of lessons on contour 
and gesture drawing ) 

- proportions of animal are reasonably accurate 2 

- evidence of foreground and background 2 

- media used well 2 

- neatness and craftmanship 2 



10 



Marking a painting, e.g., watercolor painting 

(final painting after a series of individual lessons) 



- evidence of graded and flat washes 2 

- evidence of areas left white in composition 2 

- evidence of different brush strokes 2 

- dark and light values used for contrast 2 

- general aesthetic feeling of painting, neatness 

and craftmanship 2 



10 



Marking a wire sculpture 

(final project following a series of lessons on 



handling wire) 

- strong armature 2 

- joints are secure 2 

- wrapping used to show mass 2 

- sculpture shows movement 2 

- centre of interest developed in sculpture ^ 

10 

Marking a printmaking project (stencils) 

- stencil design simplified 1 

- stencil carefully cut 1 

- evidence of clear print 2 

- repeated pattern or design shows thought 2 

- effort and workmanship _2 

8 



Marking a printmaking project (styrofoam or relief) 



- initial drawing shows skill and thought 2 

- evidence of shapes and overlapping background to 
foreground 2 

- textures are varied 2 

- evidence of clear print ( proper amount of ink 

applied to plate 2 

- neatness and craftmanship 2 



10 
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DIAGNOSTIC ART TEST 
GRADE 2 



PART A - ELEMENTS AND PRINCIPLES 
VALUE - 15 

PARTE - CONCEPT RECOGNITION 
VALUE - 10 

PART C • REFLECTION 
VALUE- 6 

PART D - SKILL RECOGNITION 
VALUE- 9 

PARTE - EXPRESSION 
VALUE - 10 



TOTAL VALUE -50 



TEACHERS ARE ASKED TO READ THE 
QUESTIONS TO THE CLASS 



NAME 



SCHOOL 
GRADE 
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1. 



PART A - ELEMENTS AND PRINCIPLES 

a) Draw a line b) Draw a square 



c) Draw an organic shape 



d) Draw an overlapping shape 



e) Draw or make a texture 



f) Draw a cube 



ERIC 



78 
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2. Complete the following questions by filling in the . blanks. You 
may choose your answers from the colors in the box. 
Colors may be used more than once. 



purple black yellow green white 
red gi'a.y blue orange brown 



a) What are the primary colors? 



Value 



b) What two colors do you mix to make: 

+ = green 

+ = orange 

+ = purple 



Value 



TOTAL VALUE 



15 
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PART B - CONCEPT RECOG>anON 



Make an X on the YES if the sentence is right or make an X on 
the NO if the sentence is wrong- 

1. a) Natural objects such as trees, rocks, grass, YES NO 

and clouds have patterns and make patterns. 

b) The four basic shapes CANNOT be found YES NO 
everywhere in the environment, i.e., square, 

rectangle, triangle, circle. 

c) Texture is the feel, roughness or smoothness YES NO 
of an object. 

d) Primary colors can be mixed to make new colors. YES NO 

e) Black and white CANNOT be used to change YES NO 
the value, lightness or darkness, of a color. 

f) Light and dark colors affect contrast . YES NO 

g) Shapes can be or ganic geometric . YES NO 

h) A horizon line can be used to divide the YES NO 
sky from the ground, 

i) An x-ray view shows the inside of an object. YES NO 

j) A continuous line drawinfi is one way to YES NO 

show what we see. 



TOTAL VALUE 

10 



ERLC 



(1 ?• 
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PART C REFLECTION 



ERIC 



1. Look at picture 3.18 from Art Images, Grade 3, and answer the 
following questions. 



a) How many trees are in this picture? 

b) How many people are playing hockey in 

this picture; 

c) What season of the year is it in this picture? 

VALUE 

3 

2. Which are closest to you; the children leaning on the fence, or 
the buildings? 



VALUE 

1 



3. Do you see something moving in the picture? ^^ES NO 

What? 



VALUE- 1 Score 



4. I feel . when I look at this picture. 

(Please give a one-word answer.) Why? This can be a class 
discussion, (ITiere are no marks for the class discussion.) 



VALUE . 1 Score 



TOTAL VALUE 

6 



M3 
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PART D . SKILL RECOGNITION 



1. Place the letter for each picture ut the blank opposite tne words 
that show the clearest example. 




2. Place one of the letters for each picture on the blank opposite 
the words that show the clearest example. 




VALUE _ 
5 



TOTAL VALUE _ 
9 
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BEST COPY ffllM 



PARTE. EXPRESSION 



You may use your pencil or pencil crayons to do this question. 
Make a drawing, on the next page, to show what is happening in 
the following paragraph. 

Some children are playing on the school 
playgrounds Some are playing tag, some hopscotch , 
and some are playing with halls and skipping 
ropes. Others are on the slide, swings, and 
climbing equipment. What do you like to do when 
you are out on the playground? 



Score 1 point each for: 

size relationship overlapping originality 

repetition or pattern line variety 



VALUE 

5 



2. You may use your pencil or pencil crayons to do this question. 
Carefully observe your shoe and draw it as accurately and with as 
much detail as possible. 



Score 1 point each for: 

line variety 

detail texture 



technique 



accuracy 



VALUE 



TOTAL VALUE 



18 



TOTAL SCORE 



ERLC 
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PARTE- EXPRESSION 

You may use your pencil or pencil crayons to do this question. 
Carefully observe your shoe and draw it as accurately and with 
as much detail as possible. 

Score 1 point each for: 

Line Variety Technique Accuracy 

Detail Texture 



TOTAL VALUE - 5 TOTAL SCORE 
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DIAGNOSTIC ART TEST 
LEVELS 



PART A - ELEMENTS A>a) PRINCIPLES 
VALUE - 15 

PARTB- CONCEPT RECOGNITION 
VALUE - 10 

PARTC- REFLECTION 
VALUE - 10 

PARTD- SKILL RECOGNITION 
VALUE- 5 

PARTE- EXPRESSION 
VALUE - 10 



TOTAL VALUE -50 



TEACHERS MAY READ THE QUESTIONS TO THE CLASS 



NAME 

SCHOOL 

GRADE 



Annan Earl 
Arts Consultant 
Alberta Education 



ERIC 
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PART A - ELEMENTS AND PRINCIPLES 

Place the correct letter on the line next to the phrase that shows 
the best example. 

1. a) Repeating pattern. 

b) Radial structure, or balance. „ 

c) Symmetrical balance. 




PART B - CONCEPT RECOGNITION 



The following statements can be TRUE of FALSE, If you think the 
statement is true, write YES in the blank. If you think it is 
not, write NO in the blank, (concepts) 



1, a) Weather conditions like fog, rain, and bright sun 
affect the way we see an object. 



b) The style of an art work affects how we feel about it. 



c) Natural forces such as water, wind, and temperature 
can change the shape of an object over a period of time. 



d) When you look at an object closely, you may look at 
its shape, color, texture, and value. 



e) This picture shows object A changing into a different 
object in B and C. 




f) This object is being viewed from below. 




g) Artists use related lines, shapes, colors, and 
textures to create unity in their work. 



ERLC 
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h) There is one shadow cast from this box. 




i) The direction and slant of a line or shape 

deteradnes whether it looks like it is stationary or moving. 

j) The style of an artwork does not affect its emotional 
impact. 



TOTAL_ 
10 



ERLC 
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PART C - REFLECTION 



Look at pictures 5.5, 5.17, and 5.25 from Art Images, Grade 5, and 
answer the following questions. 



1. a) Who is the artist in picture 5.5? 
b) Who is the artist in picture 5.17? 



c) What technique was used to produce picture 5.25? 



a) What kinds of shapes are used in picture 5.25? 
correct answers from this list: realistic 
geometric - organic. 

b) What color scheme is dominant in picture 5.5? 
correct answer from this list: primaiy 
analagous. 



Underline the 
abstract 



Underline the 
secondary - 



c) Which picture is the best example of background, middleground, 
and foreground? Put the number on the line, 

d) What kind of balance, symmetrical, or asymmetrical has been 
used in picture 5.17? 



e) Where is the greatest contrast found in picture 5.5? Between 
the and the . 



3. What emotion do you feel when you look at picture 5.5? 



4. Which picture do you like best? 5.5 ; 5.17 ; 5.25 

Why? 



VALUE 



10 



ERLC 
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PART D . SKILL RECOGNITION 



1. Place one of the letters by each picture on the blank opposite the 
words that show the clearest example. 

contour drawing 

gesture drawing 

hatching and crosshatching 



high detail drawing 




VALUE _ 
5 
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You may use your pencil or pencil crayons to do this question. Make a 
drawing to show what is happening in the following paragraph. 

Some children are having fun playing on the 
equipment in a playground. A sidewalk is in front 
of the children and some bushes and tall trees are 
behind the children. There are some clouds in the 
sky. 



ERIC 
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Score 1 point for each of: 

Movement Foreground/raiddleground/background _ 

Value (dark & light) ___ Texture Balance 



VALUE. 



in, 
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You may use your pencil or pencil crayons to do this question. 
Carefully observe your shoe and draw it as accurately and with as 
much detail as possible. 



Score 1 point for each of: 

Line variety 

Detail Texture 



Technique 



Accuracy 



VALUE 



ERLC 
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SECONDARY DIAGNOSTIC ART TCST 
GRADES 7-12 



PART A Elements, Principles, Concepts 

PARTS Self-analysis Alt Work 

PART C Critiquing 

PART D Application 



NAME: 

SCHOOL: 

GRADE: 



MARKS 

PART A (25) 

PARTB (12) 

PARTC (38) 

PARTD (25) 

TOTAL 

Possible 100 

1(^3 



SECONDARY DIAGNOSTIC ART TEST 
GRADES 7-12 



PART A: Elements, Principles, and Concepts 
MULTIPLE CHOICE 



The character of a surface depicted by the arrangement of lines and 
marks in a drawing is known as: 

a. space c. texture 

b. value d. mood 



2. Tertiary colors are created by using: 

a. primary colors c. secondary colors 

b. a triad d. a, b, and c 

3. Which of the following conditions can be expressed visually? 

a. social c. political 

b. economic d. a, b, and c 



4. On the color wheel, red, yellow, and blue form a color scheme? 

a. analogous colors c. a triad 

b . complementary d. monochromatic 



5. An analytical description of an object is best achieved by: 

a. gesture drawing c. high detail drawing 

b. outline drawing d. blind contour drawing 

6. Harmony involves: 

a. rhythm- repetition- emphasis c . economy- color 

b. dominance -proportion d. balance-proportion 

7. A sense of depth can be created by: 

a. texture c. overlapping 

b. balance d. a, b, and c 

8. Variety is best achieved through the principles of: 

a. contrast -elaboration 

b . rhythm- repetition 

c. positive and negative shapes 

d. space and value 



1^3 
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9. Mood/emotion in an art work can be affected by the use of: 

a. values c. line 

b. contrasts a, b, and c 

10. Symmetrically, asyxometrically , and radial are all forms of: 

a . balance c . dominance 

b . space d. unity 

11. The following are not principles of design. 

a. balance and movement c. line and shape 

b. rhythm and repetition d. emphasis -proportion 

12. A feeling of movement is achieved by the repetition of lines, shapes, 
colors, etc. is known as: 

a. unity c. rhythm 

b. dance d. music 



13. Colors can be made to appear: 

a. political 

b. to advance or recede according to the colors around them 

c. economic or social 

d. a, b, and c 



14. The organization of all elements and principles that make up a work 
of art is known as: 

a. style c. m^dia 

b. meaning d. unity 



15. Subject choice, media selection, and design element emphasis are used 
to express: 

a. meaning d. personal preference 

b. emotion d. a, b, and c 



16. Creativity in an art work can sometimes be enhanced by: 

a. copying* the work of others 

b. accidental occurrences 

c. following an outline 

d. a, b, and c 



lie, 
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17. The style of an art work depends on the artist's choice of color and 
other elements: 

a. affects how we feel about it 

b. depends upon the artist's choice of clothing 

c. depends on how the work is displayed 

d. b and c 

18. An object can be examined analytically to see how the whole is made 
up of its parts by looking at: 



a . color , shape , texture , values 

b . balance, overlapping, repetition 

c. unity 

d. a and b 

19. This picture shows object A changing into: 




a. a different object c. metamorphosis 

b. an alternate position d. a and c 



20. This object is being viewed from: 




a. below 

b . above 



c. straight on 

d. none of the above 




22. The following illustration is an example of: 



24. 




a. gesture drawing 

b. modeled drawing 

c. high detail drawing 

d. continuous line drawing 



23. The following illustration is an example of: 




a. modeled drawing 

b. high detail drawing 

c. continuous line drawing 

d. outline drawing 



The following illustration is an example of: 




a. outline drawing 

b. gesture drawing 

c. modeled drawing 

d. high detail drawing 



25. The following illustration is an example of: 




a. outline drawing 

b. modeled drawing 

c. high detail drawing 

d. gesture drawing 



Value - 25 
Score - 



ERLC 
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PART B: Self -analysis of an art work. 



Using a representative painting from your portfolio, please assess it 
using the following questions. Briefly explain your response to 
each question. 



1. Did you have a clear idea of what you wanted to do before you 
started this work? YES NO 

How did you develop your idea before you started this work? 

Research 

Observation 

Experimentation 

Sketching 

Other (List them 

Explanation: 



2. Did your idea change as you progressed through this project? 
YES NO 

If yes, what changed? 

Media Technique 

Message Materials 

Other (List them) 

Explanation: , 



3. Do you feel that you had the knowledge and art skills necessary 
to complete this work to your satisfaction? YES NO 

What is most succesful? 

Expression Craftmanship 

Use of media Use of materials 

Topic 

Other (List them) 

Explanation: . 
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What would you change if you were to do a similar project? 

Expression Craf tmanship 

Use of media Use of materials 

Topic 

Other (List them) 

Explanatior .: 



How successful is this work of art? 1 2 3 4 5 — 

(Least (Most 
Successful) Successful) 



In what ways do you feel that you grew as a result of this 
project? Check as many ideas as apply. 

Knowledge 

Visual awareness 

Appreciation of topic 

Understanding of yourself 

Understanding of others 

Awareness of the environment 

Cooperation with others 

Skill development 

Skill in use of materials 

Skill in use of media 

Planning skills 

Expressive skills 

Critiquing skills 

Problem solving skills 

Other . . 

Explanation: 



Value - 12 



Score 

102 
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PART C: Critiquing - Description, Analysis, Interpretation, 
Judgement 

Using the work of art from Part B, please critique this piece using 
the following techniques. 



A. DESCRIPTION: 



Title 
Size 

Subject Matter 

Media 

Techniques 



B. ANALYSIS: 



1. What kinds of shapes did you use? 



Realistic Organic 

Abstract Implied 

Geometric 

Other: (List them) Explain how or where you used each kind of 
shape . 



2. What color scheme did you use? 

Triade 

Complementary 

Analagous 

Split complementary 

Monochromatic 

Other: (List them) Explain how or where you used each color. 



3. Describe the textural quality. 



Rough 

Smooth 

Prickly 

Silky 

Grainy 

Other: (List them) Explain how or where you used each texture. 
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4. What kind of space did you use? 



Positive 

Negative 

Foreground 

Middleground 

Background 

Other: (List them) Explain how or where you used each kind of 
space . 



5. What kinds of lines did you use? 

Straight 

Curved 

Broken 

Continuous 

Implied 

Other: (List them) Explain how or where you used each kind of 
line. 



6 . How was value used? 

To create depth 

Mood 

Emotion 

Variety 

Realism 

Other: (List them) Explain how or where you used value. 



7. Answer the following questions that apply to your art work, 
a) How do line and shape work together? Describe. 
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b) How do value and space work together? Describe. 



V 



c) How do color and texture work together? Describe. 



d) Other combinations that are working together in your art work, 
e.g. , color-space, shape-value? Describe. 



8. Listed below are nine principles of design. Choose five 
which you feel are most important in your work. Explain why. 

a) Balance 



b) Repetition 

c) Rhythm 

d) Movement _ 

e) Emphasis 

f) Contrast _ 
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g) Elaboration 



h) Economy 



i) Proportion 



INTERPRETATION: 

a) How did you create mood in your art work? Use the elements 
and principles of design to support your answer. 



b) What were you trying to express or convey through your choice 
of media, materials, images, and so on? 



JUDGEMENT: 

a) What problems did you encouter in the use of: a) media and/or 
technique; b) composition? Explain. 



b) What works best in this piece of work? Explain. 



TOTAL VALUE - 50 
SCORE 
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PART D: Application - Knowledge, Skill 



Draw your hand incorporating two other objects into your composition 
using high detail drawing techniques. Be as creative as possible in 
the relationship you present between these forms. Be aware of lines, 
textures, etc. that you use to describe the different surface 
qualities. Use lines only, (e,g., dotting, hatching, crosshatching) , 
to create textures, values, contrasts, etc. You may use the opposite 
page of this test for your drawing. Your drawing will be marked 
according to the following criteria: 



Least Successful 



Most Successful 



Line Variety 

Technique 

Texture 

Detail 

Originality 



1 2 

1 2 

1 2 

1 2 

1 2 



3 
3 
3 
3 
3 



4 5 

4 5 

4 5 

4 5 

4 5 



Value - 25 
Score « 
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COMPLETE YOUR DRAWING ON THIS PAGE 
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